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© A digital color image quantization mechanism 
employs sequential product code vector quantiza- 
tion, to sequentially extract chrominance and lu- 
minance values from the vectors and quantizes 
chrominance and luminance features based upon a 
conditional distribution of these features within par- 
titioned regions of chrominance/luminance color 
space. The mechanism sequentially partitions a 
histogram of the original digital color image in lu- 
minance, chrominance (Y.Cb.Cr) space coordinates 
into a plurality off luminance-chrominance sub-re- 
gions or color space cells, such that each partitioned 
color cell is associated with a color of the output 
palette through which the color composition of a 
reproduced color image is defined. A splitting cri- 
terion is employed to determine the sequential order 
of partitioning of an axis. Because off the increased 
sensitivity off the human visual system to contouring 
artifacts in regions of an image to low spatial activity, 
the splitting criterion along the luminance axis is 
scaled or weighted in inverse proportion to the aver- 
age spatial activity of the luminance-chrominance 
region subject to be split. A map of chrominance 
and luminance output codes is generated for the 
respective pixels of the output color image in accor- 
dance with the axial splitting or quantization of the 
chrominance and luminance components of the 



histogram. The resulting map of chrominance and 
luminance output codes of the output digital color 
image is then transformed into sets of RGB output 
color codes for application to the respective RGB 
digital-to-analog converters that drive the color im- 
age reproduction device. 




FIG. 1 



Rank Xerox (UK) Business Services 

(3.10/3.6/3-3.1) 



1 



EP 0 555 835 A2 



2 



FIELD OF THE INVENTION 

The present invention relates in general to digi- 
tal color image processing, and is particularly di- 
rected to a mechanism for quantizing a digital color 
image having a relatively high color encoding pre- 
cision into a , palette' of color codes that may be 
stored in a relatively low data resolution color im- 
age memory, the contents of which are employed 
to reproduce an output color image having a high 
quality that is pleasing to the human visual system. 

BACKGROUND OF THE INVENTION 

Many color image output devices which are 
driven by digital color image databases employ an 
image frame buffer the capacity of which is consid- 
erably less than that of the encoding resolution into 
which an original color image has been digitized by 
a color opto-electronic imaging device, such as a 
high precision digitizing color camera. A typical 
example of this mismatch in data precision is the 
use of an eight bit frame buffer in association with 
a color image output device, such as a color dis- 
play monitor, to store a digital color image having a 
data precision of twenty-four bits (eight bits per 
color per pixel). 

Since the output device (e.g. color display) 
usually has a resolution of eight bits per color at 
the input of each of three respective digital-to- 
analog converters which drive its red, green and 
blue signal ports, it is possible for the output de- 
vice to replicate any of the colors within the original 
image, as long as a code representative of that 
particular color is stored in the frame buffer. Un- 
fortunately, in the previous example, the limited 
capacity of the frame buffer means that only 256 
out of 16 million possible colors codes are avail- 
able to define the original digital color image may 
be stored. As a consequence, it is necessary to 
generate a color conversion mechanism through 
which each of the colors of the original input image 
(e.g. out of a possibility of 2 2+ = 1 6x1 0 7 colors) is 
effectively transformed into one of a lesser number 
of output colors (e.g. 2 s =256 colors) for driving the 
display. 

Color conversion quantization has been the 
fundamental technique for reducing the color code 
resolution of the original color image size to a 
limited palette of color codes that can be accom- 
modated by the frame buffer and which are se- 
lected to as faithfully as possible replicate the color 
characteristics of the original image. Color conver- 
sion quantization typically has involved some form 
of vector quantization and operates to minimize an 
objective error criterion (usually mean squared er- 
ror). 



One class of quantization techniques, as de- 
scribed in articles by P. Heckbert, entitled "Color 
image quantization for frame buffer display," Com- 
puter Graphics, Vol. 16, No. 3, pp 297-307, July 

5 1972, G. Braudaway, entitled "A procedure for opti- 
mum choice of a small number of colors from a 
large color palette for color imaging," Electronic 
Imaging , 87, San Francisco CA, 1987 and R. Gen- 
tile et al entitled "Quantization of color images 

w based on uniform color spaces," Journal of Imag- 
ing Technology, Vol. 16, No. 1, pp.1 2-21, Feb 

1990, selects an initial color palette and iteratively 
refines it using the algorithm described in an article 
by Y. Linde et al, entitled "An algorithm for vector 

75 quantizer design," IEEE Transactions on Commu- 
nications, Vol. COM-28, pp 84-95, Jan. 1980. While 
these vector quantization mechanisms yield high 
quality images, they are very computationally in- 
tensive. 

20 Another approach, described in an article by R. 

Balasubramanian et al, entitled "A new approach to 
palette selection for color images," Journal of Im- 
aging Technology, Vol. 17, No. 6, pp.284-290, Dec. 

1991, and based upon a clustering vector quantiza- 
25 tion technique proposed in an article by W. Equitz 

entitled "A new vector quantization algorithm," 
IEEE Transactions on Acoustics, Speech, Signal 
Processing, Vol. 37. No. 10, pp 1568-1575, Oct. 
1989, starts with all of the colors of an image and 

30 groups colors into clusters by merging one nearest 
neighbor pair of clusters at a time until the number 
of clusters equals the desired number of palette 
colors. The centroids of the clusters are selected 
as the palette colors. Tree structures are used to 

35 perform efficient nearest neighbor searches. In ad- 
dition, this scheme employs histogramming to re- 
duce the number of initial colors and a spatial 
activity weighting to take into account the sensitiv- 
ity of the human visual system to quantization 

40 errors in relatively 'smooth' regions of the image. 

A third class of vector quantization algorithms 
uses splitting techniques to divide the color space 
into smaller sub-regions and selects a representa- 
tive palette color from each sub-region. In general, 

45 splitting techniques are computationally more effi- 
cient than either the iterative or merging techniques 
and can provide a structure to the color space that 
enables efficient pixel mapping at the output. 

One of these splitting techniques, termed a 

so 'median cut' algorithm, recursively splits a region 
into two sub-regions by locating a plane perpen- 
dicular to the coordinate axis having the greatest 
range (where the range is the difference between 
the maximum and minimum values of that coordi- 

55 nate) and which passes through the median point 
of that coordinate axis. 

A second splitting technique is a variance- 
based algorithm which splits the region having the 
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largest total squared error (TSE). Data points are 
projected onto each of the coordinate axes and the 
projected TSEs computed. The region is then split 
along that axis yielding the smallest sum of projec- 
ted TSEs from the two resulting sub-regions. For a 
detailed discussion of the variance splitting algo- 
rithm attention may be directed to an article by S. 
Wan et al, entitled "Variance based color image 
quantization for frame buffer display", COLOR Re- 
search and Applications, Vol. 15, No. 1, pp 52-58 
Feb. 1990. 

A third splitting algorithm, which is the most 
optimal in a quantitative sense, is the binary split- 
ting algorithm. The binary splitting algorithm 
passes a splitting plane through the centroid of all 
the colors of the region such that the splitting plane 
is oriented perpendicular to the direction of maxi- 
mum total squared variation. The latter is derived 
from the principal eigenvalue and eigenvector of 
the covariance matrix of the data in that region. At 
each step the region to be split is that with the 
largest associated principal eigenvalue. The binary 
splitting algorithm also incorporates spatial activity 
measures to enhance the subjective quality of the 
image. For a detailed discussion of the binary 
splitting algorithm attention may be directed to an 
article by M. Orchard et al, entitled "Color quan- 
tization of images", IEEE Transactions on Signal 
Processing Vol. 39, No. 12, pp 2677-2690, Dec. 
1991. 

SUMMARY OF THE INVENTION 

The present invention is directed to a reduced 
computational complexity digital color image quan- 
tization mechanism which employs a sequential 
product code form of vector quantization, to se- 
quentially extract chrominance and luminance val- 
ues from the vectors and quantize chrominance 
and luminance features based upon a conditional 
distribution of these features within partitioned re- 
gions of chrominance/luminance color space. The 
present invention is particularly intended to quan- 
tize a relatively high data resolution digital color 
image, such as the twenty-four bit per pixel digitiz- 
ed color image output by a digitizing color camera, 
into a reduced, practical number or 'palette* of 
eight bit color codes that are to be stored within 
the limited capacity memory of the frame buffer 
associated with an output device for reproducing 
the original digital color image. Even though the 
frame buffer has a considerably reduced storage 
capacity (eight bits per pixel versus twenty-four bits 
per pixel of the original digital color image), the 
palette codes chosen by the sequential product 
code image quantizing mechanism in accordance 
with the invention are those that effectively prevent 
the generation of contouring artifacts in the repro- 



duced image and provide an output image having a 
quality that is pleasing to the human visual system. 

The sequential product code vector quantiza- 
tion mechanism sequentially partitions a digital im- 

5 age color space (e.g. a luminance, chrominance 
color space) with respect to its vector coordinate 
system (e.g. (Y,Cb,Cr) space coordinates) into a 
plurality of color space sub-regions or color space 
cells, such that each partitioned color cell is asso- 

?o ciated with a color of the output palette through 
which the color composition of a reproduced color 
image is defined. At a first step of the partitioning 
process, the color space (e.g. histogram in lu- 
minance, chrominance (Y, Cb, Cr) color space co- 

15 ordi nates) is subdivided into a plurality of parallel 
slices along a selected first of its color space axes, 
such as along one of the Cr and Cb chrominance 
axes. This subdivision of the color space is prefer- 
ably accomplished by performing a sequential bi- 

20 nary splitting of an axis, either at a prescribed 
number of axial splitting locations, or adaptively in 
dependence upon a performance measure of the 
results of successive splits, such as a mean 
squared error criterion. Where the initial split of the 

25 (Y, Cb, Cr) color space is to take place along one 
of the chrominance axes, which of the two Cb, Cr 
axes is chosen to begin the sequential splitting 
process is that chrominance axis (Cb or Cr) a split 
of which realizes & larger reduction in total squared 

30 error (TSE). 

Whenever the color space is to be partitioned 
along one of its coordinate axes, a splitting criterion 
is employed to determine the sequential order of 
partitioning of the axis. The splitting criterion is 

35 equal to the product of the number of data values 
projected upon the segment of the axis to be split 
and the variance of the data along that segment of 
the axis. The segment of the axis having the larg- 
est splitting criterion is split first. After that segment 

40 has been split into two sub-segments, respective 
splitting criteria are then computed for the sub- 
segments and compared with the splitting criteria 
for all other segments of the axis. Again, that 
segment (or sub-segment) of the axes having the 

45 largest splitting criterion is split next. This process 
is repeated either until the axis has been par- 
titioned into the number of splits initially assigned 
to it or, in the case of adaptive partitioning, until or 
adaptively in dependence upon an 'on-the-fly* per- 

50 formance measure (e.g. mean squared error cri- 
terion) of the results of successive splits during the 
splitting process. 

Because of the increased sensitivity of the hu- 
man visual system to low spatial activity, where the 

55 color space is defined in terms of luminance, 
chrominance coordinates, the splitting criterion 
along the luminance axis is scaled or weighted in 
inverse proportion to the average spatial activity of 
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the region subject to be split. Thus, a region of 
lower spatial activity will have a higher weighting 
value, which is intended to emphasize a region of 
lower spatial activity, where contouring artifacts are 
a potential problem. 

The number of splits along each respective 
axis will determine the number of regions or •cells' 
into which the histogram color space is subdivided, 
and thereby determines the number of colors of 
the palette. For a conventional eight bit frame buff- 
er, the total number of available palette codes is 
256. From a practical standpoint, for representative 
sets of color images to which the present invention 
has been applied, it has been found that each of 
the chrominance axes Cr and Cb may be split at 
seven or eight locations, while there may be on the 
order of 240 splits of the partitioned chrominance 
regions into luminance-chrominance subregions. 
This large number of splits along the luminance 
axis has been found to effectively eliminate objec- 
tionable contouring artifacts, thereby resulting in a 
high quality image that is pleasing to the human 
visual system. 

The locations along a color space coordinate 
where partitioning is to occur are defined in accor- 
dance with a preselected splitting control function. 
Where binary splitting is employed to partition the 
color space, each split location along an axis may 
correspond to the centroid or mean value of the 
color space population as projected onto the seg- 
ment of that axis. At each binary split location 
along an axis, the color space (e.g. a luminance, 
chrominance histogram) is partitioned by a plane 
which is perpendicular to the axis and passes 
through the mean value of the color space popula- 
tion as projected onto that axis. 

Thus, in the case of a luminance, chrominance 
color space (histogram), binary splitting of a first 
chrominance axis, such as the Cb axis, produces a 
set of color space 'slices* , each of which is asso- 
ciated with a quantization code value of the se- 
lected chrominance coordinate. Namely, the digital 
value of the first chrominance coordinate of any 
pixel of the original digital color image will be 
quantized to a code value used to identify the slice 
in which that digital value occurs. 

After the color space (luminance, chrominance 
histogram) has been split into a plurality of color 
space slices along the first chrominance axis, each 
of these slices is iteratively split into a plurality of 
column or strip-shaped luminance-chrominance re- 
gions along the second chrominance axis, by per- 
forming a binary splitting of the second axis at a 
number of axial locations, that may be prescribed 
or determined adaptively, as noted earlier. Again, 
where binary splitting is employed to partition the 
color space, each split location along the second 
(chrominance) axis preferably corresponds to the 



centroid or mean value of the color space popula- 
tion of a respective one of the slices resulting from 
the first split as projected onto the second chromin- 
ance axis. 

5 The strip-shaped luminance-chrominance re- 

gions resulting from the second chrominance axis 
split effectively represent quantization code values 
associated with the second chrominance compo- 
nent. Namely, the digital value of the second 

w chrominance component of any pixel of the original 
digital color image will be quantized to a code 
value used to identify the partitioned luminance- 
chrominance column in which that digital vaJue 
occurs. 

75 For a luminance, chrominance color space 

(histogram), where the chrominance axes are par- 
titioned first, the resulting column or strip-shaped 
luminance-chrominance regions are then sequen- 
tially partitioned into a plurality of luminance- 

20 chrominance sub-regions by performing a binary 
splitting of the luminance axis. Each split location 
along the luminance axis corresponds to the cen- 
troid or mean value of the color space population 
within the column as projected onto the segment of 

25 the luminance axis. At each binary split location 
along the luminance axis, the color space is par- 
titioned by a plane which is perpendicular to the 
luminance axis and passes through the mean value 
of the column of color space population as projec- 

30 ted onto the luminance axis. Luminance axis parti- 
tioning is sequentially repeated until the total num- 
ber of cells (partitioned luminance-chrominance 
subregions) corresponds to the desired number of 
palette colors. The luminance-chrominance sub-re- 

35 gions resulting from the luminance axis split effec- 
tively represent quantization code values associ- 
ated with the luminance component. Namely, the 
digital value of the luminance component of any 
pixel of the original digital color image will be 

40 quantized to a code value used to identify the 
partitioned luminance-chrominance sub-region in 
which that digital value occurs. 

After the quantization of the (Y,Cr,Cb) color 
space, the luminance (Y) and chrominance (Cr, Cb) 

45 codes are reconverted back into respective R, G 
and B code values. For this purpose, a video 
memory in which palette color labels are stored 
may be coupled to a look-up table which generates 
RGB values associated with the palette color la- 

50 bels. The RGB outputs from the look-up table are 
applied to respective D-A converters associated 
with the RGB ports of an image output device. 

BRIEF DESCRIPTION OF THE DRAWINGS 

55 

Figure 1 diagrammatically illustrates an example 
of a color image processing system in which the 
quantization mechanism of the present invention 
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may be employed; 

Figure 2 diagrammatical ly illustrates an eight- 
by-eight matrix of encoded chrominance values 
for the Cr component of an image, whose color 
coordinates have been transformed from an s 
RGB color space to a Y,Cb,Cr color space, 
associated with each of the pixels of an eight- 
by-eight (sixty-four pixels) image array; 
Figure 3 diagrammatically illustrates an eight- 
by-eight matrix of encoded luminance Y values w 
of the Y.Cb.Cr-transformed image associated 
with each of the pixels of the array; 
Figure 4 shows a matrix of luminance variation 
values derived from the luminance matrix of 
Figure 3; 15 
Figure 5 is a two-dimensional histogram of the 
pixel population of the matrices of Figures 2 and 
3; 

Figure 6 is a color activity diagram generated in 
accordance with the histogram of Figure 5 and 20 
variation values of Figure 4; 
Figure 6A shows the partitioning of the Cb axis 
with a projection of seven binary splitting planes 
on the Cb-Cr plane; 

Figure 6B shows the Cr axis-partitioning of the 25 
partitioned color space diagram of Figure 6A; 
Figure 6C shows a set of look-up tables, each of 
which is associated with a respective one of the 
quantization/partitioning of a respective axis of a 
Y,Cb,Cr histogram; 30 
Figure 7 is a marginal Cr histogram derived 
from the histogram of Figure 5; 
Figure 8 shows the manner in which the histo- 
gram of Figure 5 is split into a chrominance- 
partitioned histogram having respective chromin- 35 
ance regions Cr1 and Cr2; 
Figure 9 is a quantized Cr chrominance value 
look up table; 

Figures 10, 11 and 12 are respective illustrations 
showing luminance partitioning of the 40 
chrominance-partitioned histogram of Figure 8; 
Figure 13 shows a quantized luminance- 
chrominance sub-region look-up table; 
Figure 14 is a palette color map tabulating cal- 
culated centroid values; 45 
Figure 15 spatially associates each of the pixels 
of the image array of Figures 2 and 3 with one 
of the numerical vaJues of the respective 
luminance-chrominance sub-regions of the par- 
titioned histogram of Figure 13, and tabulated in 50 
the look-up table of Figure 13; and 
Figure 16 diagrammatically illustrates the con- 
nection of a video memory in which the color 
codes of the palette are mapped to their respec- 
tive twenty-four bit color values by way of a 55 
look-up table which drives respective D-A con- 
verters associated with the RGB ports of an 
image output device. 



DETAILED DESCRIPTION 

Before describing in detail the digital color im- 
age quantization mechanism in accordance with 
the present invention, it should be observed that 
the present invention resides primarily in what is 
effectively a prescribed digitized image transforma- 
tion operator which may, but need not necessarily, 
be incorporated within the image processing soft- 
ware employed by a digital color image processing 
system. Consequently, the configuration of such a 
system and the manner in which it is interfaced 
with a digital image color source (e.g. a digitizing 
high precision (e.g. twenty-four bits per pixel) color 
imagery scanner) and a color image output device 
(e.g. eight bits per pixel color display) have been 
illustrated in the drawings by readily understan- 
dable block diagrams, which show only those spe- 
cific details that are pertinent to the present inven- 
tion, so as not to obscure the disclosure with 
details which will be readily apparent to those 
skilled in the art having the benefit of the descrip- 
tion herein. Thus, the block diagram illustrations 
and the image processing diagrams of the Figures 
are primarily intended to illustrate the major com- 
ponents of the system in a convenient functional 
grouping, and an example of the application of the 
image processing operators of the present inven- 
tion to an illustrative example, whereby the present 
invention may be more readily understood. 

Figure 1 diagrammatically illustrates an exam- 
ple of a color image processing system in which 
the quantization mechanism of the present inven- 
tion may be employed. The exemplary system 
comprises a high color precision opto-electronic 
color image digitising scanner 12, the output of 
which is coupled to a host digitised image proces- 
sor (host computer) and attendant video display 
terminal (VDT) 14. Scanner 12 contains a sensor 
pixel array capable of generating output signals 
which, when converted into digital format, yield a 
'digitized* color image file from which high a quality 
color output image may be obtained. 

This digitally encoded data file, or •digitized* 
color image, is supplied in the form of an imaging 
pixel array-representative bit map, resolved to a 
prescribed code width (e.g. eight bits per color per 
pixel), to host processor 14. Thus, for a three 
primary color (RGB) digitizing scanner, each pixel 
of its bit map output is encoded to twenty-four bits. 
Host processor 14 contains an image encoding and 
storage operator, through which each digitized col- 
or image file is stored, for retrieval of the digitized 
images for reproduction on a color image output 
device, such as an RGB color video display 16. A 
digital-to-analog converter unit 18 is associated 
with display 16 for driving the respective red, green 
and blue color guns of the display with analog 
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video signals. 

As pointed out previously, the capacity of the 
frame buffer employed with an output device, such 
as color display 16, may be typically on the order 
of eight bits per pixel, a code width which is 
considerably less than the twenty-four bits per pixel 
into which an original color image has been digitiz- 
ed by scanner 12. However, since each of three 
respective digrtal-to-anaJog converters of the 
digital-to-analog converter unit 18 that drives the 
RGB ports of display 16 has a resolution of eight 
bits, it is possible for color display 16 to replicate 
any of the colors within the original digital color 
image, as long as a code representative of that 
particular color is stored in the frame buffer. Con- 
sequently, it is necessary for host image processor 
14 to incorporate a color conversion mechanism 
through which each color code of the digitized 
image output of scanner 12 (which may be any 
color within a total spectrum of 2** = 1 .6x1 0 7 color 
codes available to define the original digital color 
image) is effectively transformed or mapped into 
one of a lesser number of output colors (e.g. 
2 s =256 colors) for driving output device 16. 

In accordance with the present invention, such 
a color conversion mechanism quantizes a rela- 
tively high data precision digital color image, such 
as the twenty-four bit per pixel digitized color im- 
age output by digitizing scanner 12, into a limited 
number or •palette' of eight bit color codes that are 
to be stored within a limited capacity memory of 
the frame buffer associated with the output device 
for reproducing the original digital color image. 
Even though the frame buffer has a considerably 
reduced storage capacity (eight bits per pixel ver- 
sus twenty-four bits per pixel output by scanner 
12), the palette codes chosen by the image quan- 
tizing mechanism in accordance with the invention 
are those that effectively minimizes the generation 
of contouring artifacts in the reproduced image and 
provide an output image having a quality that is 
pleasing to the human visual system. 

As explained supra, the colors of the output 
color code palette are selected by means of a 
sequential product code vector quantization mecha- 
nism which sequentially partitions the color space 
of a digital color image, such as a 
chrominance/luminance histogram of the digital col- 
or image into a plurality of luminance-chrominance 
sub-regions or color space cells, such that each 
partitioned cell is associated with a color of the 
output palette through which the color composition 
of a reproduced color image is defined. 

In accordance with an exemplary embodiment 
of the present invention applied to a luminance, 
chrominance (Y,Cb,Cr) histogram of the digital col- 
or image, at a first step of the partitioning process, 
the color space luminance, chrominance histogram 



is subdivided into a plurality of parallel slices along 
a first of the Cr and Cb chrominance axes, by 
iteratively performing a binary splitting of that axis, 
typically at a plurality of locations, the number of 

5 which may be predetermined or arrived at adap- 
tively, during the splitting process. Each axial split 
location of the selected chrominance axis corre- 
sponds to the centroid or mean value of the lu- 
minance, chrominance histogram population as 

io projected onto that chrominance axis within the 
segment of the axis being split. At each binary split 
location along the chrominance axis, the histogram 
is partitioned by a plane which is perpendicular to 
that axis and passes through the mean value. The 

75 luminance-chrominance slices resulting from this 
first chrominance axis split effectively represent 
quantization code values associated with the first 
chrominance component. Namely, the digital value 
of the first chrominance component of any pixel of 

20 the original digital color image will be quantized to 
a code value used to identify the slice in which that 
digital value occurs. 

After the histogram has been split into a plural- 
ity of slices along the first chrominance axis, each 

25 of these slices is split in an iterative manner into a 
plurality of column or strip-shaped luminance- 
chrominance regions along the second chromin- 
ance axis, by performing a binary splitting of the 
second axis. Each split location of the second axis 

30 corresponds to the centroid or mean value of the 
histogram population of a respective one of the 
slices resulting from the previous split as projected 
onto the second chrominance axis. At each binary 
split location along the second chrominance axis, a 

35 histogram slice is partitioned by a plane which is 
perpendicular to the second chrominance axis and 
passes through the mean value of the slice popula- 
tion as projected onto the second chrominance 
axis. The luminance-chrominance strips resulting 

40 from the second chrominance axis split effectively 
represent quantization code values associated with 
the second chrominance component. Namely, the 
digital value of the second chrominance component 
of any pixel of the original digital color image will 

45 be quantized to a code value used to identify the 
partitioned luminance column in which that digital 
value occurs. 

The luminance-chrominance regions are then 
sequentially partitioned into a plurality of 

so luminance-chrominance sub-regions by performing 
a binary splitting of the luminance axis. Each split 
location along the luminance axis corresponds to 
the centroid or mean value of the histogram popu- 
lation of a respective one of the luminance- 

55 chrominance regions (or a luminance-chrominance 
sub-region). At each binary split location along the 
luminance axis, a luminance-chrominance region or 
sub-region is partitioned by a plane which is per- 
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pendicular to the luminance axis and passes 
through the mean value of the histogram population 
of that region or sub-region as projected onto the 
luminance axis. 

The order in which luminance-chrominance re- 
gions or sub-regions are partitioned along the lu- 
minance axis is influenced by the spatial activity in 
the luminance-chrominance regions. After each 
split of a luminance-chrominance region or sub- 
region, spatial activity variance values are updated 
(variance values of the two sub-regions of the most 
recent split are calculated). The next luminance- 
chrominance region or sub-region split is then 
based upon which of the luminance-chrominance 
regions and any luminance-chrominance sub-re- 
gions resulting from the most recent split has the 
largest weighted splitting criterion. This luminance 
axis partitioning process is sequentially repeated 
until the total number of histogram cells (partitioned 
color space (luminance-chrominance) subregions) 
corresponds to the desired number of palette col- 
ors. 

The quantized luminance coordinates of the 
color space sub-regions resulting from the lumi- 
nance axis split effectively represent quantization 
code values associated with the luminance compo- 
nent of the digital color image. Namely, the digital 
value of the luminance component of any pixel of 
the original digital color image will be quantized to 
a code value used to identify the partitioned 
luminance-chrominance sub-region in which that 
digital value occurs. 

For each of the partitioned histogram sub-re- 
gions or color cells, a respective set of luminance 
and chrominance (Y,Cr,Cb) output codes is derived 
from the centroid of each color cell. A map of these 
chrominance and luminance output codes is then 
generated for the respective pixels of the output 
color image in accordance with the previously con- 
ducted axial splitting or quantization of the 
chrominance and luminance components of the 
histogram. The resulting map of chrominance and 
luminance output codes of the output digital color 
image is then transformed into sets of RGB output 
color codes for application to the respective RGB 
digital-to-analog converters that drive color image 
reproduction device 16. For this purpose, a video 
memory in which palette color labels are stored is 
coupled to a look-up table which generates RGB 
values associated with the palette color labels. The 
RGB outputs from the look-up table are applied to 
respective D-A converters associated with the RGB 
ports of an image output device. 

To facilitate an understanding of the present 
invention, in the description to follow, the sequence 
of steps through which the sequential product code 
vector quantization mechanism is carried out will 
be described for the case of a reduced spatial 



complexity digital color image, specifically a sixty- 
four pixel image comprised of an array of eight 
rows and eight columns of pixels. The resolution to 
which each coordinate is encoded will be four bits 

5 (rather than the customary eight bits), in order to 
simplify computation. It should be understood, 
however, that such a reduced spatial complexity 
image and data resolution are merely for purposes 
of example and are not to be considered limitative 

10 of images which may be processed in accordance 
with the present invention. In addition, to simplify 
the drawings, the image processing sequence will 
be illustrated in terms of two dimensions of a 
luminance, chrominance (Y.Cb.CR) color space, 

75 specifically with respect to a single chrominance 
coordinate (Cr) and the luminance coordinate (Y). 

In its originally encoded output form a digitized 
color image (sixty-four pixels in the present exam- 
ple) output by scanner 12 of the system of Figure 

20 1 is an RGB image, with each respective color 
(red, green, blue) encoded to eight bits, for a total 
of twenty-four bits per pixel. Since the human vi- 
sual system (HVS) attaches different importance to 
the luminance (Y) and chrominance (C) attributes of 

25 a color stimulus, the original digitized color image 
that has been encoded in terms of RGB coordi- 
nates is transformed into a luminance-chrominance 
(Y.Cr.Cb) space prior to quantization. The 
luminance-chrominance space employed is prefer- 

30 ably related to a gamma-corrected RGB space of 
the output device 16 by means of a linear trans- 
formation customarily employed in color image 
processing, as described for example in the text by 
A. Natravali entitled "Digital Pictures," Plenum 

35 Press, 1988. 

In a practical embodiment of the transform 
operator, with each of the gamma-corrected R, G 
and B code values of the original digitized color 
image being encoded to an eight bit resolution 

40 (values 0-255), yielding a total encoding resolution 
of twenty-four bits per pixel, the color space trans- 
formation may be given by: 

Y = 0.299R + 0.587G + 0.1 14B 
45 Cr = 0.627(R-Y) + 128 
Cb = 0.496(B-Y) + 128, 

where the Y coordinate of the transformed color 
space is associated with the gamma-corrected lu- 

50 minance component representing achromatic col- 
ors, the Cr coordinate is associated with the red- 
green color variation and the Cb coordinate is 
associated with the yellow-blue color variation. 

Figure 2 diagram matically illustrates an eight- 

55 by-eight matrix of encoded chrominance values for 
the Cr component of the RGB-Y,Cb,Cr transformed 
image associated with each of the pixels of a sixty- 
four pixel image array. Figure 3 diagrammatical ly 
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illustrates an eight-by-eight matrix of encoded lu- 
minance Y values of the Y,Cb,Cr-transformed im- 
age associated with each of the pixels of the array. 
A similar eight-by-eight matrix of encoded chromin- 
ance values for the Cb component of the RGB- 
Y.Cb.Cr transformed image associated with each of 
the pixels of a sixty-four pixel image array is also 
formed. However, as noted above, in order to sim- 
plify the complexity of the drawings, this additional 
matrix is not shown. Also, in the spatial matrices of 
Cr and Y values, in order to reduce numerical 
complexity, each pixel of each eight-by-eight array 
is resolved to four bits (encompassing sixteen data 
values 0-15). The x and y axes of Figures 2 and 3 
are the respective spatial axes of the pixel matrix 
into which a color image has been digitized. In 
effect, therefore, the spacial matrices of Figures 2 
and 3 are respective chrominance (Cr) and lu- 
minance (Y) images derived from a transform of 
the original RGB image into Y.Cr.Cb color space. 
(As noted previously, a second chrominance (Cb) 
image matrix (not shown) is also obtained from the 
RGB-Y,Cb,Cr transformation operation.) 

As noted earlier, the sequential product code 
vector quantization mechanism of the present in- 
vention employs spatial activity information to con- 
trol the order of partitioning of the luminance- 
chrominance regions, that are obtained by sequen- 
tial partitioning of a Y,Cb ? Cr histogram of the image 
along the Cb and Cr axes. The use of spatial 
activity information to refine the composition of the 
color code palette achieves a key aspect of the 
present invention - minimizing contouring artifacts. 
Repeated ('refined 1 ) partitioning of those 
luminance-chrominance sub-regions of the histo- 
gram having a relatively low spatial activity will 
ensure that the color palette includes a sufficient 
number of variations or shades of a color in a 
(relatively smooth) region of relatively low spatial 
frequency, so that a (spatially) large area or region 
of an image that is essentially the same color, but 
has HVS-perceptible gradations in tone and shad- 
ing, will not be reproduced without such gradations, 
as would be the case if a single given color code 
were used to reproduce the area of interest, giving 
rise to a 'cartoon' effect artifact. Conversely, in high 
spatial frequency, or 'busy', regions of the image, 
where color detail is less perceptible to the human 
visual system, the number of components of the 
palette can be reduced without degrading the qual- 
ity of the reproduced image. 

In order to have spatial activity information 
available during luminance axis partitioning, a ma- 
trix of luminance variation values shown in Figure 4 
is derived from the luminance matrix of Figure 3. 
Specifically, the luminance variation matrix of Fig- 
ure 4 is derived by spatially subdividing the matrix 
of Figure 3 into a sub-matrix of regions, identified 



as matrix regions 21 in Figure 4, with each region 
21 being associated with a plurality (four in the 
example shown) of mutually adjacent pixels of the 
luminance image. For each region 21 of Figure 4, 

5 the variation of the luminance values associated 
with its associated pixels of Figure 3, is computed. 
The term variation corresponds to the average of 
the absolute values of the deviation from the mean 
of each group of luminance values of Figure 3 of a 

10 respective region 21 of Figure 4. Thus, for the pixel 
set (x = 4,5; y = 6,7) of the luminance image matrix 
of Figure 3, the mean luminance value is 8.0. For 
the four adjacent pixels of the set (x = 4,5; y = 6,7), 
whose luminance values are the set (13, 2, 2, 15), 

75 the absolute values of the deviations are (5, 6, 6, 
7), yielding an average of 6.0, as specified within 
the corresponding region of Figure 4. 

An examination of Figure 4 reveals that lu- 
minance variation is relatively small (less than 1.0, 

20 with seven out of eight regions having a value of 
0.5) over the left half of the image array, indicating 
that the left half of the image is relatively smoothly 
varying, whereas the right half of the image array, 
having considerably larger luminance variation val- 

25 ues (up to 6.0), is 'busy*. Consequently, the even- 
tually encoded color palette can be expected to 
contain a relatively larger number of color codes 
associated with different tonal shades for reproduc- 
ing the left half of the image without contouring 

30 artifacts, and a lesser number of color codes asso- 
ciated with the higher spatial frequencies of the 
right half of the image. 

The basic mechanism used to derive the color 
code components of the reproduction color palette 

35 comprises a histogram of the luminance (Y) and 
chrominance (Cr, Cb) representative codes of the 
digitized image. A two-dimensional histogram of 
the pixel population of the matrices of Figures 2 
and 3 is shown in Figure 5, having an abscissa or 

40 Cr axis that has been prequantized into in succes- 
sive pairs of Cr values, and an ordinate or Y axis 
denoted in successive luminance (Y) values. Not 
shown in Figure 5 is a third axis of the overall 
Y,Cb,Cr histogram, which is perpendicular to the 

45 plane of the drawing and is associated with the Cb 
chrominance component. Like the Cr axis, the 
histogram distribution along the Cb axis is prequan- 
tized in successive pairs of Cb values. In effect, the 
two-dimensional histogram of Figure 5 may be 

so considered to represent the Y.Cb.Cr histogram of 
an image for which all of the pixels have the same 
Cb value. 

A first step in the sequential product code 
vector quantization mechanism of the present in- 
55 vention is the partitioning of the Y.Cb.Cr histogram 
along one of its chrominance axes, either the Cr 
axis or the Cb axis by a prescribed number of 
planes that are perpendicular to that axis and pass 
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through centroids of the segment of the axis being 
sliced. Thereafter, the other chrominance axis is 
partitioned, followed by the partitioning of the lu- 
minance axis. For purposes of reducing the com- 
plexity of the present description, the participation 
of the Cb coordinate will be temporarily ignored. 
Suffice it to say that at the beginning of the parti- 
tioning process, which of the Cr and Cb chromin- 
ance axes is partitioned first is determined in ac- 
cordance with which coordinate has the largest 
associated reduction in total squared error for an 
initial split along that axis. 

For this purpose, all of the data points of the 
three-dimensional histogram space are projected 
upon each of the Cr and Cb axes. For each Cr and 
Cb axis the centroid CBAR of the projected data 
points is determined. Each axis is then split at its 
centroid into first and second axial segments S1 
and S2, along which are distributed respective first 
and second sets n1 and n2 of data points, where 
n1 and n2 are the numbers of pixels in each group. 
The two sets of data points n1 and n2, have 
respective centroids C1BAR and C2BAR. Math- 
ematically, the reduction D in total squared error 
(TSE) is given by the expression: 

Dtse = (n1n2/(n1+n2))|C1BAR-C2BARj 2 

The value Dtse is determined for each Cr and 
Cb axis. The axis having the larger value of Dtse is 
partitioned first. The number of splits along each 
respective axis will determine the number of re- 
gions or 'cells 1 into which the histogram color 
space is subdivided, and thereby determines the 
number of colors of the palette. For a conventional 
eight bit frame buffer, the total number of available 
palette codes is 256. From a practical standpoint, 
for representative sets of color images to which the 
present invention has been applied, it has been 
found that each of the chrominance axes Cr and 
Cb of their associated luminance/chrominance 
histograms may be split at seven or eight locations, 
while there may be on the order well over 200 
splits of the partitioned chrominance regions into 
luminance-chrominance sub-regions. This large 
number of splits along the luminance axis has been 
found to effectively eliminate objectionable con- 
touring artifacts, thereby resulting in a high quality 
image that is pleasing to the human visual system. 

Again, ignoring for the moment, the Cb axis, it 
will be assumed that the color palette to be created 
(the number of cells into which the two dimensional 
histogram of Figure 5 is to be partitioned) will 
contain five output color codes, derived from a 
single split of the Cr axis into a pair of chrominance 
regions which, in turn, are partitioned along the 
luminance axis until the histogram has been sub- 
divided into a total of five color cells. With a single 



split of the Cr axis into two chrominance regions, 
three additional splits along the Y axis are required 
to partition the two chrominance regions into five 
luminance-chrominance sub-regions. The centroids 

5 of these five sub-regions represent the output color 
codes of the palette. 

Each of the chrominance axes (Cr, Cb) of the 
histogram is prequantized into pairs of chromin- 
ance values. This prequantization is to take advan- 

io tage of the fact that the human visual system is 
less sensitive to chrominance variations than lu- 
minance variations, thus making it possible to re- 
duce computational complexity by prequantizing 
the chrominance data, dropping the least significant 

T5 bit. Thus, the chrominance axes of the histogram 
need be only half as wide (three most significant 
bits) as the luminance axis, which is full code 
resolution (four bits = sixteen luminance values) 
and thereby retains spatial variations in brilliance. 

20 Using the histogram of Figure 5 and the lu- 

minance variation values of Figure 4, a color activ- 
ity diagram shown in Figure 6 is next generated. 
The color activity diagram of Figure 6 is obtained 
by associating each luminance value of the spatial 

25 luminance image of Figure 3 with respective values 
of the spatial chrominance image of Figure 2 and 
assigning to the associated chrominance and lu- 
minance values one of the variation values of Fig- 
ure 4. 

30 More particularly, for each associated set of 

luminance and chrominance values derived from 
Figures 2 and 3, there is at least one variation 
value set forth in Figure 4. Since the human visual 
system is more sensitive to low spatial activity 
35 values, then, for those coordinate (Cr,Y) pairs of 
Figure 6 associated with multiple pixels, whose 
locations in Figure 4 fall within different pixel 
groups and have more than one luminance vari- 
ation magnitude, the lowest variation magnitude is 
40 assigned to that chrominance/luminance pair in 
building the color activity diagram of Figure 6. For 
example, the (Cr,Y) coordinate pair (14,15) occurs 
twice in Figures 2 and 3, but with different spatial 
variation values of 6.0 and 4.5 listed in Figure 4 for 
45 the two occurrences. The lower variation value of 
4.5 is inserted into the corresponding coordinate 
location (Cr = 14,15; Y = 15) of the spatial activity 
diagram of Figure 6. 

An examination of the activity diagram of Fig- 
so ure 6 reveals where, in terms of the chrominance 
coordinate Cr, the image will likely require a plural- 
ity of output color code values. In the present 
example the chrominance values at the left side of 
the histogram of Figure 5 (for lower Cr values) have 
55 relatively low activity values listed in Figure 6, to 
which the human visual system is more sensitive, 
so that their associated color within the image will 
require an increased number of tonal shades to 
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prevent contouring artifacts. 

In the histogram of Figure 5, the Cr chromin- 
ance components of the image of the present ex- 
ample are concentrated in the vicinity of two 
(extreme) regions of the color space, rather than 
being spread across the entire color spectrum. This 
implies that the chrominance components of the 
color palette will congregate in the vicinity of two 
regions, one at the lower end of the chrominance 
axis and one at the upper end of the chrominance 
axis. (It should be noted that not every image will 
have its histogram split into only two chrominance 
regions; typically more regions of concentrated 
chrominance activity can be expected. The occur- 
rence of two regions at opposite ends of the Cr 
chrominance axis in the present example is merely 
for purposes of illustration.) 

To quantize the Cr chrominance component in 
terms of the two chrominance regions of the histo- 
gram of Figure 5, it is necessary to subdivide or 
split the histogram into chrominance regions along 
the chrominance axis. As described above, the 
sequential product code vector quantization mecha- 
nism of the present invention sequentially partitions 
the histogram first along the respective chromin- 
ance coordinates and then along the luminance 
coordinate. In particular, for whichever chrominance 
axis is partitioned first (based upon its larger reduc- 
tion in total squared error, described above) a 
prescribed number of partitioning splits is iden- 
tified. 

As explained above, for representative sets of 
color images to which the present invention has 
been applied, it has been found that the chromin- 
ance axes Cr and Cb may be subjected to seven 
or eight binary splits. Thus, if the calculation of the 
reduction in total squared error selects the Cb axis 
to be split first, and the Cb axis is then subjected 
to seven binary splits, the histogram will have been 
partitioned into eight parallel slices along the Cb 
axis. 

In accordance with the present invention, a 
splitting criterion L is employed to determine the 
sequential order of partitioning of the axis. For each 
of the chrominance axes Cb and Cr the splitting 
criterion L is equal to the product of the number of 
data values projected upon the segment of the axis 
to be split and the variance of the data along that 
segment of the axis. The segment of the axis 
having the largest splitting criterion L is split first. 
After that segment has been split into two sub- 
segments, respective splitting criteria are then 
computed for the sub-segments and compared 
with the splitting criteria for all other segments of 
the axis. Again, that segment (or sub-segment) of 
the axis having the largest splitting criterion is split 
next. This process is repeated until the axis has 
been partitioned into the number of splits initially 



assigned to it. 

The partitioning of the Cb axis is diagrammati- 
cally illustrated in Figure 6A, which shows the 
projection of seven binary splitting planes Cb1-Cb7 

5 on the Cb-Cr plane, which are perpendicular to the 
Cb axis and subdivide the histogram into eight 
parallel slices SCb1 - SCb8. Namely, because the 
partitioning is a binary operation, the number of 
partitioned segments or regions is always one 

w more than the number of splits. In the diagram of 
Figure 6A, eight slices SCb1- SCb8 result from 
seven splits Cbs1-CBs7. 

With the Cb axis partitioned into eight regions, 
the Cr axis is split next. For the case of eight splits 

75 of the second axis (the Cr axis), it is possible, but 
not necessarily the case, that each split of the Cr 
axis will be associated with a respectively different 
one of the eight parallel slices SCb1-SCb8 of Fig- 
ure 6A. Again, where each split occurs will depend 

20 upon the above-reference splitting criterion L. 
Namely, in order to partition the slices of Figure 6A 
along the Cr axis, it is necessary to compute a 
splitting criterion for each of the eight parallel slices 
SCb1-SCb8. That slice having the largest splitting 

25 criterion is split first, at the centroid of the slice. 
After, this initial split, respective splitting criteria are 
computed for the two regions into which the slice 
has been partitioned and compared with the split- 
ting criteria of all other slices. Again, the slice (or 

30 sub-slice) having the largest splitting criterion is 
split next. 

As an example, for the eight parallel slices 
SCb1-SCb8of the diagram of Figure 6A, let it be 
assumed that slice Scb1 has the largest splitting 

35 criterion. Then slice Scb1 will be split at its cen- 
troid, shown in Figure 6B as split Crs1, into two 
sub-slices or regions, one of which is to the left of 
split Crs1 and one of which is to the right of split 
Crs1 , as viewed in Figure 6B. After computing the 

40 splitting criteria for these two regions, let it be 
assumed that slice SCb3 has the largest splitting 
criterion. As a result, slice Scb3 will be split at its 
centroid, shown in Figure 6B as split Crs3, into two 
sub-slices or regions, one of which Rcr5 is to the 

45 left of split Crs3 and one of which Rcr6 is to the 
right of split Crs3. This process of sequential split- 
ting and updating the splitting criteria continues 
until the partitioned histogram of Figure 6A has 
been split along the Cr axis a total of eight splits. 

so Figure 6B shows an example of how Figure 6A 
might be split after eight splits. Note that no split- 
ting of slices Scb2 or Scb6 has occurred, while 
each of slices Scb1 and ScbS contains two splits. 
The second chrominance axis split (along co- 

55 ordinate axis Cr) thereby subdivides the histogram 
into twice as many regions in the Cr-Cb plane as 
the number of splits along the second (Cr) axis to 
be partitioned. Each of the resulting regions RCr1- 
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RCr16 may be considered a sub-slice or column 
extending parallel to the Y axis or orthogonal to the 
plane of Figure 6B. These sixteen regions or col- 
umns RC1-RC16 are then further partitioned by 
sequential binary splitting along planes orthogonal 
to the Y axis, until the color space has been 
subdivided into a total of 256 luminance-chromin- 
ance sub-regions or color cells. 

Splitting the histogram into eight quantized 
segments or slices SCb1-SCb8 along the first (Cb) 
axis yields a code width of three bits. Subdividing 
the eight slices of the first axial split into sixteen 
quantization sub-regions RCr1-RCr16 requires a to- 
tal code width of four bits, or one additional bit. 
The remaining available slices of the regions RCr1- 
RCr16 of Figure 6B into 240 luminance sub-regions 
requires a total of eight bits, or four bits in addition 
to the four bits associated with the Cb and Cr axial 
partitioning. By constructing a set of look-up tables, 
as diagrammatically illustrated in Rgure 6C, each 
of which is associated with a respective one of the 
quantization/partitioning of a respective axis of the 
histogram a very rapid mapping of the luminance 
and chrominance values of the original digital color 
image into output code values of a transform color 
palette may be accomplished. The manner in 
which such a set of look up tables is obtained in 
accordance with the sequential product code quan- 
tization mechanism of the present invention wilf 
now be described. 

As described earlier, in the present example, 
the color palette to be created is to contain five 
output color codes. For the histogram of Rgure 5, 
there will be a single split along the chrominance 
axis which will create two chrominance regions. 
These two chrominance regions will then be further 
partitioned along the luminance axis until a total of 
five luminance-chrominance sub-regions are real- 
ized. The centroids of these five sub-regions repre- 
sent the output color codes of the palette. 

In order to determine where, along the 
chrominance axis, the histogram should be split, a 
simplified or 'compacted* version of the histogram 
of Figure 4 may be created by projecting onto the 
Cr axis the sums of the histogram values along the 
Y axis, thereby producing a 'marginal Cr histogram' 
shown in Rgure 7. In accordance with the sequen- 
tial product code quantization mechanism of the 
present invention, the chrominance axis is par- 
titioned by a prescribed number of sequential bi- 
nary splits beginning with the centroid or mean of 
the marginal Cr histogram, and proceeding through 
the centroids of the split regions or segments into 
which the marginal histogram has been partitioned 
by the split, and so on, until the Cr axis has been 
partitioned into a plurality of chrominance regions 
the number of which is one more than the pre- 
scribed number of splits. 



For a single split along the Cr chrominance 
axis, then a chrominance region partitioning point 
Crp is that which passes through the mean of the 
marginal Cr histogram of Rgure 7. For the data of 

5 the present example, partitioning point Crp falls at 
a Cr value of 8.5. Partitioning the histogram of 
Rgure 5 into respective chrominance regions at 
this Cr value (Cr=8.5) produces a chrominance- 
partitioned histogram shown in Rgure 8, containing 

w chrominance regions Cr1 and Cr2. 

Since any color value within the color palette 
must fall into one of these two chrominance re- 
gions (Cr1 or Cr2), only a single bit is required to 
quantize the chrominance component. For this pur- 

15 pose, a chrominance region map or look up table 
(LUT) shown in Figure 9 is derived. This chromin- 
ance LUT effectively corresponds to the chromin- 
ance look up table CrLUT in Rgure 6C, referenced 
previously, and is defined by quantizing the original 

20 four bits resolution of the Cr chrominance data 
(covering chrominance values 0-15) into a single bit 
(0 or 1). Namely, for the above-referenced 
chrominance axis split value of 8.5, all chrominance 
values of the digitized image having a magnitude 

25 less than 9.0 are quantized to a chrominance bit 
value of '0', while all chrominance values of the 
digitized image having a magnitude of 9.0 or great- 
er are quantized to a chrominance bit value of '1'. 
In accordance with sequential product code 

30 technique of the present invention, the splitting 
criterion employed to determine the order of parti- 
tioning of the palette color space along the lu- 
minance axis of the histogram is 'weighted' in 
accordance with the associated distribution of the 

35 color activity, set forth in Rgure 6. Specifically, 
luminance-chrominance region partitioning is gov- 
erned by which of the regions produces the largest 
'weighted' splitting criterion, based upon spatial 
activities within the regions. 

40 More particularly, as explained above, the nor- 

mal splitting criterion L is equal to the product of 
the number of data values projected upon the 
segment of the axis to be split and the variance of 
the data along that segment of the axis. The seg- 

45 ment of the axis having the largest splitting cri- 
terion L is split first. After that segment has been 
split into two sub-segments, respective splitting 
criteria are then computed for the sub-segments 
and compared with the splitting criteria for all other 

so segments of the axis. Again, that segment (or sub- 
segment) of the axis having the largest splitting 
criterion is split next. This process is repeated until 
the axis has been partitioned into the number of 
splits initially assigned to it. When splitting along 

55 the luminance axis, however, the sensitivity of the 
human visual system to contouring artifacts in an 
image region with low spatial activity is taken into 
account in order to minimize contouring artifacts. 
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The present invention operates to avoid con- 
touring artifacts in the image reproduced from the 
color palette by including within the color code 
capacity of the palette a sufficient number of vari- 
ations or shades of a color for an image region of 
relatively low spatial frequency. As a result, a 
(spatially) large region of an image that is essen- 
tially the same color but has HVS-perceptible gra- 
dations in tone and shading will not be reproduced 
without such gradations, as would be the case if a 
single given color code were used to reproduce the 
area of interest, giving rise to the previously men- 
tioned •cartoon' effect. Conversely, in high spatial 
frequency regions of the image, where color detail 
is less noticeable to the human visual system, the 
number of color codes can be reduced without 
degrading the quality of the reproduced image. 

In order to determine where, along the lu- 
minance axis of the histogram, luminance-based 
partitioning should occur, the color activity diagram 
of Figure 6 is used to generate weighting values wr 
for scaling the splitting criteria L of each of the 
regions of interest to modified splitting criteria L\ 
The weighting value wr of each region is calculated 
to be equal to the reciprocal of the average activity 
of the region. The average activity is computed to 
be the averaged sum of the products of the num- 
ber of data values for each respective luminance 
value within the region and the activity value for 
that luminance value as listed in Figure 6. The 
averaging is taken over the total number of data 
values within the region for which the splitting 
criterion is to be calculated. 

Thus, a region of lower spatial activity will have 
a higher weighting value, which is intended to 
emphasize a region of lower spatial activity, where 
contouring artifacts are a potential problem. In the 
histogram of the present example, because of its 
very substantial spread, the weighted luminance 
activity of chrominance region Cr2 is larger than 
that of chrominance region CM, so that splitting 
along the luminance axis will take place first within 
chrominance region Cr2. The partitioning of 
chrominance region Cr2 along the Y axis of the 
histogram is determined by computing the Y axis 
mean of the histogram data within chrominance 
region Cr2, tabulated in a conditional luminance 
histogram YCr2 shown in Figure 8 adjacent to 
chrominance region Cr2. The term 'conditional' is 
used to describe a marginal histogram the color 
space coverage of which is conditional upon a 
previous partitioning of the color space. Thus, in 
Figure 8, since the contents of each of chromin- 
ance regions Cr1 and Cr2 is conditional upon the 
manner in which the chrominance axis Cr has been 
partitioned, marginal histograms YCr1 and Ycr2 re- 
spectively associated with regions Cr1 and Cr2 are 
termed conditional histograms. 



In the present example, the mean of the con- 
ditional luminance histogram YCr2 is calculated 
between a value of 8.0 and 9.0 and therefore is 
located at a Y value of 9.0. Thus, for the first split 

5 along the Y axis of the histogram, the sequential 
product code splitting criterion causes chrominance 
region Cr2 to be partitioned into a luminance- 
chrominance sub-region YCr2-1 encompassing lu- 
minance values 0-8 and a luminance-chrominance 

w sub-region YCr2-2 encompassing luminance values 
9-15, as diagrammatically shown in Figure 10. 

After partitioning chrominance region Cr2, re- 
spective weighted splitting criteria L' are generated 
for each of luminance-chrominance sub-regions 

75 YCr2-1 and YCr2-2 and are compared with the 
(previously calculated) weighted splitting criterion 
L' for chrominance region Cr1 (which has not yet 
been partitioned along the Y axis), in order to 
determine which region is to be partitioned next. 

20 The updating of the weighted splitting criteria re- 
veals that, with chrominance region Cr2 having 
been partitioned into luminance-chrominance sub- 
regions YCr2-1 and YCr2-2 because of its very 
substantial spread, the weighted splitting criteria L' 

25 of each of luminance-chrominance sub-regions 
YCr2-1 and YCr2-1 are calculated to be smaller 
than that of chrominance region Cr1, so that 
chrominance region Cr1 is partitioned next. 

As described above, the partitioning of a 

30 chrominance region along the Y axis of the histo- 
gram is determined by computing the Y axis cen- 
troid of the histogram data within that region, here 
using the marginal luminance histogram YCr1 
shown in Figure 10 adjacent to chrominance region 

35 Cr1. In the present example, the mean of the 
marginal luminance histogram YCr1 is calculated to 
occur between a value of 3.0 and 4.0, which 
causes chrominance region Cr1 to be partitioned 
into a luminance-chrominance sub-region YCr1-1 

40 encompassing luminance values 0-3 and a 
luminance-chrominance sub-region YCr1-2 encom- 
passing luminance values 4-1 5, as shown in Figure 
11. At this point in the sequential product code 
vector quantization process, the histogram has 

45 been partitioned into four of the five cells that will 
make up the color code palette. 

To determine the Y axis location of the final 
luminance split (the fourth in the present example, 
to realize five palette color cells within the histo- 

50 gram), respective weighted splitting criteria are 
generated for each of luminance-chrominance sub- 
regions YCr1-1 and YCr1-2 and compared with the 
(previously calculated) weighted splitting criteria for 
each of luminance-chrominance sub-regions YCr2- 

55 1 and YCr2-2. The weighted splitting criterion of 
luminance-chrominance sub-region YCr1-1 is the 
largest of the four, so that luminance-chrominance 
sub-region YCr1-1 is partitioned into a pair of sub- 
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regions YCr1-1a and YCr1-1b, shown in Figure 12 
as encompassing luminance values 0-2 for sub- 
region YCr1-la and luminance value 3 for 
luminance-chrominance sub-region YCr1-1b. The 
sequential product code partitioning of the histo- 
gram into the five requisite cells is now complete 
and is represented by the partitioning of the mar- 
ginal luminance histograms YCr1 and YCr2 of Fig- 
ure 12. 

The partitioned marginal luminance histograms 
YCr1 and YCr2 of Figure 12 are next combined into 
a luminance look-up table illustrated in Figure 13, 
with numerical code values 0-4 used to identify 
with which of respective partitioned luminance- 
chrominance sub-regions YCr1-1a, YCr1-1b, YCr1- 
2, YCr2-1 and YCr2-2, matrix locations of the histo- 
gram are associated. Namely, the look-up table of 
Figure 13 has a one-bit chrominance code to iden- 
tify one of the chrominance regions Cr1 and Cr2, 
as denoted by the chrominance region map or look 
up table shown in Figure 9 and corresponding to 
look-up table CrLUT in the cascaded configuration 
of Figure 6C. 

As described previously, in the chrominance 
region LUT of Figure 9, all chrominance values of 
the digitized image within chrominance region Cr1 
are quantized to a chrominance bit value of '0', 
while all chrominance values of the digitized image 
within chrominance region Cr2 are quantized to a 
chrominance bit value of T. Chrominance bit value 
'0* is associated with marginal luminance histogram 
YCr1, and chrominance bit value T is associated 
with marginal luminance histogram YCr2. Thus, 
Figure 13 effectively associates a chrominance bit 
value and a luminance bit value with one of the 
numerical code values 0-4 that identifies one of the 
partitioned luminance-chrominance sub-regions 
YCr1-1a, YCr1-1b, YCr1-2, YCr2-1 and YCr2-2, 
each of which represents one of the five palette 
colors. 

The actual chrominance and luminance values 
used to define each color code of the palette are 
the Cr and Y coordinates of the centroids of the 
respective luminance-chrominance sub-regions of 
the partitioned histogram of Figure 12. These cal- 
culated centroid values are tabulated in the palette 
color map shown Figure 14, which lists each 
luminance-chrominance sub-region, its associated 
numerical value employed in the Y look-up table of 
Figure 13 and the calculated Cr and Y coordinates 
of the centroids of each sub-region. 

In order to map the palette values tabulated in 
the map of Figure 14 into the image array, an 
output image map shown in Figure 15 is created. 
Specifically, Figure 15 spatially associates each of 
the pixels of the image array with one of the 
numerical values (0-4) of the respective luminance- 
chrominance sub-regions of the histogram, and 



tabulated in the look-up table of Figure 13. To 
create the map of Figure 15, for a pair of x,y 
coordinates of a respective pixel of each of the 
chrominance and luminance image arrays of Fig- 

5 ures 2 and 3, a chrominance Cr value and a 
luminance value Y of the original digital color im- 
age are obtained. For example, for the x,y coordi- 
nate pair (x = 5, y = 6), the original image (Figures 2 
and 3) has a chrominance value of Cr = 15 and a 

m luminance value of Y=2. From the Cr LUT of 
Figure 9, an input Cr value of Cr = 15 is quantized 
to a value off 'V. From the Y LUT of Figure 13, the 
quantized Cr value of '1' and the luminance value 
of '2* produce the luminance-luminance sub-region 

T5 numerical identifier Thus, the palette code iden- 
tifier '3 1 is loaded into the output image matrix 
coordinate location (x = 5, y = 6) of Figure 15. 

As pointed out previously, although the fore- 
going example of the sequential product code vec- 

20 tor quantization mechanism of the present invention 
has been described and illustrated for a two-dimen- 
sional Y-Cr color space, it is actually carried out for 
a three-dimensional color space, taking into ac- 
count the Cb coordinate of the Y.Cr.Cb coordinate 

25 system, so that the respective histograms and as- 
sociated conversion tables of Figures 5-12 are ac- 
tually associated with a three-dimensional color 
space. Thus, as demonstrated by the cascaded 
look-up tables of Figure 6C, the resulting output 

30 code map of Figure 14 for the complete three- 
dimensional color space will also include a listing 
of output Cb values, in addition to the Y and Cr 
values currently listed. 

After the quantization of the Y,Cr,Cb color 

05 space, the luminance (Y) and chrominance (Cr, Cb) 
codes are reconverted back into respective R, G 
and B code values. For this purpose, as shown in 
Figure 16, a video memory 31 in which palette 
color labels are stored may be coupled to a look- 

40 up table 33, which generates RGB values asso- 
ciated with the palette color labels. The RGB out- 
puts of look-up table 33 are applied to respective 
D-A converters 35R, 35G and 35B associated with 
the RGB ports of the image output device 16. 

45 Because the processing of three dimensional 

data, particularly the storing of a three dimensional 
histogram in an associated three dimensional 
memory array, may require an extremely large 
amount of memory (e.g. even with the prequan- 

50 tization of the two chrominance components a 
256x128x128 (four megabytes) array), alternative 
processing of the histogram is desirable. This is 
particularly true where the histogram contains a 
large number of 'no data 1 entries, as illustrated in 

55 the example of Figure 5 for chrominance values 
Cr = (4-13), and over the range of luminance values 
(Y = 6-15) for chrominance values (Cr = 0-3). Also, 
for chrominance value (Cr = 12-13), the histogram 
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contains a luminance value entry only at (Y = 2). 

In accordance with alternative histogram pro- 
cessing, rather than provide memory for the entire 
three dimensional range of the histogram, the 
amount of memory employed is histogram entry- 
dependent. Pursuant to a first alternative, histogram 
entries are generated sequentially in association 
with quantization processing along each respective 
coordinate axis. In particular, only marginal and 
conditional histograms, such as the marginal Cr 
histogram illustrated in Figure 7, and the condi- 
tional luminance histograms YCr1 and YCr2 shown 
in Figures 8, 10 and 11 are generated. Thus, for 
the first chrominance axis to be quantized, only a 
single one-dimensional marginal histogram (which 
comprises a summation of all data entries projec- 
ted upon the respective axis), is generated. In the 
simplified two-dimensional example described 
above in which the Cb chrominance axis has not 
been illustrated, quantization of the first axis pro- 
cessed (the Cr axis) requires only a one-dimen- 
sional marginal histogram (Figure 7). 

The sequential processing of the next coordi- 
nate also employs one dimensional histogram stor- 
age. For the second axis processed, however, a 
plurality of one-dimensional histograms are re- 
quired. Specifically, the number of conditional 
histograms required for any coordinate axis will 
depend upon the number of conditional histograms 
employed to quantize the previous axis and the 
number of splits of that axis. Thus, as described 
previously, in the illustrated two-dimensional exam- 
ple, in addition to the single marginal histogram for 
the Cr coordinate, a pair of conditional histograms 
are generated for the luminance coordinate in asso- 
ciation with the two quantized regions YCr1 and 
YCr2 into which the Cr coordinate has been par- 
titioned based upon the processing of its one di- 
mensional histogram. 

This sequential one-dimensional histogram pro- 
cessing is attractive, not only because less mem- 
ory is required, but less computation is needed to 
generate a one-dimensional histogram than to build 
a three-dimensional histogram. Moreover, because 
the one-dimensional approach looks at data only 
along one axis, the maximum size of a data set is 
the range of the coordinate, not the product of all 
three coordinates. Thus, for a digital image en- 
coded to eight bits per color per pixel, the maxi- 
mum size of the data set is 256 entries, rather than 
256x256x256. There is a trade-off with speed how- 
ever, using the one-dimensional histogram pro- 
cessing approach, particularly in the course of 
quantizing along the luminance axis, since multiple 
(three) passes through the image are required. Still, 
this scheme offers a significant reduction in mem- 
ory requirements. 



Another data entry-dependent method to re- 
duce histogram memory involves the generation of 
a two-dimensional array to represent the three- 
dimensional histogram. For this purpose, the three- 

5 dimensional color space is stored in terms of two 
coordinates, e.g. the Cr and Cb chrominance co- 
ordinates. Each entry of the array is a look-up table 
of color data covering the range of the luminance 
values for a respective chrominance coordinate lo- 

70 cation. In effect, this array is a compressed version 
of the three-dimensional histogram, the degree of 
compression depending upon the number of color 
space coordinates having no data entries. An entry 
value of a third coordinate, such as luminance, may 

75 be stored as a binary tree structure. When acces- 
sing the two-dimensional array a corresponding 
value of a third coordinate data entry is located by 
conducting a binary search along the third coordi- 
nate (luminance axis) of the two-dimensional array. 

20 A significant processing advantage of the 

present invention is the manner in which the above 
described quantization look-up tables are effec- 
tively cascaded with one another, as shown in 
Figure 6C, which allows the image data to be read 

25 in, pixel by pixel, and thus obviates the need to 
store the entire image in memory. Moreover, since 
it is unnecessary to store the entire image in mem- 
ory in order to perform instantaneous mapping at 
the output of the process, it is not necessary to use 

30 the entire image in order to configure the output 
color code palette. 

In addition, the present invention may also be 
used with subsampled images. The image may be 
subsampled either vertically (along the y axis), 

35 horizontally (along the x axis), or both. Moreover, 
the samples may be nonuniform ly spaced. In the 
case of subsampling the image by a factor m in 
each spatial direction (x and y), then the number of 
pixels being processed is reduced by a factor of 

40 m 2 ; consequently, processing time can be reduced. 
The effect of subsampling in the course of sequen- 
tial splitting will depend upon the extent to which 
the subsampling of the image reduces the number 
of distinct colors. Still, a significant reduction in 

45 processing time is afforded with only a minimal 
reduction in image quality. 

As will be appreciated from the foregoing de- 
scription, the sequential product code vector quan- 
tization technique of the present invention effec- 

so tively serves as a digital image data compression 
mechanism that is capable of successfully quan- 
tizing chrominance and luminance features of an 
image based upon a conditional distribution of 
these features within partitioned regions of 

55 chrominance/luminance color space. The sequen- 
tial product code scheme provides a set of coordi- 
nate conversion look-up tables which, when cas- 
caded together, provide a transform operator for 
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rapidly converting the color value of each pixel of 
an original image into an output image color code 
that both closely matches the color of the original 
image and is spatial activity dependent, so as to 
prevent the generation of contouring artifacts in the 5 
reproduced image. 

While we have shown and described several 
embodiments in accordance with the present in- 
vention, it is to be understood that the same is not 
limited thereto but is susceptible to numerous w 
changes and modifications as known to a person 
skilled in the art, and we therefore do not wish to 
be limited to the details shown and described here- 
in but intend to cover all such changes and modi- 
fications as are obvious to one of ordinary skill in 15 
the art. Preferred embodiments of the invention are 
disclosed in the claims and also the dependent 
claims, which should be read as depending not 
only on the specified claims, but on any other 
claim and combination thereof. The same is true 20 
for the following summary of the invention: 

The invention may be summarized as follows: 

1. A method of converting a first digital color 25 
image, having the color composition of each of 
its pixels encoded into first luminance and 
chrominance representative codes of a first en- 
coded color resolution, to a second digital color 
image having the color composition of each of so 
its pixels encoded at a second encoded color 
resolution different from that of said first digital 
color image and color codes of which are se- 
lected to reproduce a color image having a 
quality that is pleasing to the human visual sys- 35 
tern comprising the steps of: 

(a) subdividing said first digital color image 
into a plurality of spatially adjacent groups of 
pixels; 

(b) for each group of pixels subdivided in 40 
step (a), deriving a luminance activity value 
from the first luminance representative codes 
associated therewith; 

(c) generating a histogram of said first lu- 
minance and chrominance representative 45 
codes; 

(d) associating the luminance activity values 
derived in step (b) with the histogram gen- 
erated in step (c); 

(e) partitioning said histogram, along an axis 50 
associated with the chrominance component 

of said first digital color image, into histogram 
chrominance regions, based upon the 
chrominance composition of said histogram; 

(f) partitioning said histogram chrominance 55 
regions, along an axis associated with the 
luminance component of said first digital col- 
or image, into histogram luminance-chromin- 



ance regions, based upon the distribution of 
the luminance activity values within said 
histogram chrominance regions; 

(g) for each of said histogram chrominance 
and luminance regions, deriving a respective 
set of chrominance and luminance output 
codes based upon the manner in which 
chrominance composition and luminance ac- 
tivity is distributed within said histogram 
chrominance and luminance regions, respec- 
tively; and 

(h) defining the color composition of a re- 
spective pixel of said second digital color 
image in accordance with one of the sets of 
chrominance and luminance output codes de- 
rived in step (g). 

2. A method according to 1, wherein step (h) 
comprises generating a map of chrominance 
and luminance output codes for the respective 
pixels of said second digital color image in 
accordance with a quantization of the chromin- 
ance component of said first digital color image 
into chrominance values associated with said 
histogram chrominance regions. 

3. A method according to 2, wherein step (h) 
comprises generating said map of chrominance 
and luminance output codes in accordance with 
the luminance representative codes through 
which the color composition of each of the pix- 
els of said first digital color image is encoded. 

4. A method according to 1 , further comprising 
the step of 

(i) transforming said map of chrominance and 
luminance output codes of said second digital 
color image into sets of output color codes 
for application to a color image reproduction 
device through which a color output image is 
provided. 

5. A method of quantizing the color composition 
of a digital color image comprising the steps of: 

(a) generating a histogram of the color com- 
position of the pixels of said digital color 
image in terms of prescribed color coordi- 
nates through which the color composition of 
said digital image is definable; 

(b) performing sequential product code parti- 
tioning of said histogram along its respective 
coordinate axes, so as to subdivide said 
histogram into a plurality of color space re- 
gions; and 

(c) for each of the color space regions into 
which said histogram has been subdivided in 
step (b), deriving a respective output code 
representative of the color space contents of 
that region. 

6. A method according to 5, further including the 
step of (d) associating respective ones of the 
output codes derived in step (c) with pixels of an 



15 



29 



EP 0 555 835 A2 



30 



output image, which correspond spatially to the 
pixels of said digital color image. 

7. A method according to 6, further including the 
step of (e) transforming the respective codes of 
said output image into output color codes for 5 
application to a color image reproduction device 
through which a color output image is provided. 

8. A method according to 5, wherein at least one 
of the prescribed color coordinates of the histo- 
gram generated in step (a) is prequantized to a 10 
digital resolution less than the digital resolution 

to which said at least one of the prescribed 
color coordinates of said digital color image is 
encoded. 

9. A method according to 8, wherein the pre- 75 
scribed color coordinates of said digital color 
image correspond to respective chrominance 

and luminance coordinates of the color space 
into which said digital color image has been 
encoded. 20 

10. A method according to 9, wherein said at 
least one prescribed color coordinate of the 
histogram generated in step (a) includes a 
chrominance coordinate. 

11. A method according to 10, wherein the pre- 25 
scribed color coordinates of said digital color 
image correspond to a luminance and a pair of 
chrominance coordinates of the color space into 
which said digital color image has been en- 
coded, and wherein said at least one prescribed 30 
color coordinate of the histogram generated in 
step (a) includes each of said chrominance co- 
ordinates. 

12. A method according to 5, wherein the pre- 
scribed color coordinates of said digital color 35 
image correspond to a luminance coordinate 

and a pair of chrominance coordinates of the 
color space into which said digital color image 
has been encoded, and wherein each of the 
chrominance coordinates of the histogram gen- 40 
erated in step (a) is prequantized to a digital 
resolution less than the digital resolution to 
which said digital color image is encoded, and 
said luminance coordinate of the histogram gen- 
erated in step (a) has the same digital resolution 45 
as said digital color image. 

13. A method according to 5, wherein the pre- 
scribed color coordinates of the color space of 
said digital color image correspond to a lu- 
minance coordinate and a pair of chrominance 50 
coordinates, and wherein said step (b) of per- 
forming sequential product code partitioning of 

said histogram along its respective coordinate 
axes comprises sequentially splitting said 
chrominance coordinates and thereafter splitting 55 
said luminance coordinate. 

14. A method according to 5, wherein the co- 
ordinates of the color space of said digital color 



image correspond to a luminance coordinate 
and a pair of chrominance coordinates, and 
wherein said step (b) of performing sequential 
product code partitioning of said histogram com- 
prises performing sequential binary splitting of 
the histogram axes in accordance with a splitting 
criterion that depends upon the variance of the 
contents of said histogram for that portion of a 
respective axis to be split. 

15. A method according to 13, wherein step (b) 
comprises sequentially partitioning said lumi- 
nance coordinate using a splitting criterion that 
depends upon spatial activity characteristics of 
said digital color image. 

16. A method according to 5, including the pre- 
liminary step of subsampling said digital color 
image to provide a sub-array of digital color 
pixels and steps (a) - (c) are carried out with 
respect to the subsampled digital color image. 

17. A method according to 5, wherein step (c) 
comprises, for each of the coordinates of said 
histogram, generating a respective look-up table 
that associates the digitized color composition 
for that respective coordinate of said digital col- 
or image with a quantized color space region. 

18. A method according to 5, wherein step (a) 
comprises generating sad histogram in the form 
of one-dimensionaJ histograms of the color 
space activity of said digital color image, the 
composition of each one-dimensional histogram 
being referenced to a respective one of the 
color coordinates through which the color com- 
position of said digital image is definable. 

19. A method according to 18, wherein step (b) 
comprises performing sequential product code 
partitioning of said one-dimensional histograms 
along their respectively associated coordinate 
axes, so as to subdivide said histograms into a 
plurality of color space regions. 

20. A method according to 5, wherein step (a) 
comprises generating a two-dimensional array 
off color space coordinate data entries, respec- 
tive ones of which are associated with a range 
of color coordinate values of a further color 
space coordinate. 

21 . A method of generating a plurality of color 
codes, respective ones of which represent the 
color composition of a digital color image com- 
posed of an array of pixels, the color composi- 
tions of which are digitized to a prescribed color 
code resolution, comprising the steps of: 

(a) generating a histogram of the color com- 
position of the pixels of said digital color 
image in terms of prescribed color coordi- 
nates through which the color composition of 
said digital image is definable; 

(b) quantizing the color composition of histo- 
gram by performing sequential product code 
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partitioning of said histogram along its re- 
spective coordinate axes into a plurality of 
color cells; 

(c) for each of the color cells into which said 
histogram has been partitioned in step (b), 5 
generating a respective color code represen- 
tative of the color space contents of that cell. 

22. A method according, to 21 , wherein step (c) 
comprises generating a respective color code 
representative of the centroid of the color space w 
contents of that cell. 

23. A method according to 21, wherein step (c) 
comprises, for each of the coordinates of said 
histogram, generating a respective look-up table 

that associates the digitized color composition 75 
for that respective coordinate of said digital col- 
or image with its quantized coordinate value. 

24. A method according to 23, wherein step (c) 
comprises cascading the look-up tables togeth- 
er, and generating therefrom, in response to the 20 
color composition of a pixel of said digitized 
color image, a respective color code which is 
representative of the color composition of said 
digital color image. 

25. A method according to 21, further including 25 
the step of (d) associating respective ones of 

the color codes generated in step (c) with pixels 
of an output image, which correspond spatially 
to the pixels of said digital color image. 

26. A method according to 25, further including 30 
the step of (e) transforming the respective color 
codes of said output image into output color 
codes for application to a color image reproduc- 
tion device through which a color output image 

is provided. 35 

27. A method according to 21, wherein at least 
one of the coordinate axes of the histogram 
generated in step (a) is prequantized to a digital 
resolution less than the digital resolution to 
which said at least one of the color coordinates 40 
of said digital color image is encoded. 

28. A method according to 27, wherein the co- 
ordinates of said digital color image correspond 
to respective chrominance and luminance co- 
ordinates off the color space into which said 45 
digital color image has been encoded. 

29. A method according to 28, wherein the co- 
ordinates of said digital color image correspond 
to a luminance coordinate and a pair of chromin- 
ance coordinates of the color space into which 50 
said digital color image has been encoded, and 
wherein each of the chrominance coordinates off 

the histogram generated in step (a) is prequan- 
tized to a digital resolution less than the digital 
resolution to which said digital color image is 55 
encoded, and said luminance coordinate of the 
histogram generated in step (a) has the same 
digital resolution as said digital color image. 



30. A method according to 21, wherein the co- 
ordinates of the color space of said digital color 
image correspond to a luminance coordinate 
and a pair of chrominance coordinates, and 
wherein said step (b) quantizing the color com- 
position of histogram by performing sequential 
product code partitioning of said histogram 
along its respective coordinate axes comprises 
performing sequential binary splitting in accor- 
dance with a splitting criterion that depends 
upon the variance of the contents of said histo- 
gram for that portion of a respective axis to be 
split. 

31. A method according to 30, wherein step (b) 
comprises sequentially partitioning said 
chrominance coordinates, and thereafter splitting 
said luminance coordinate. 

32. A method according to 31, wherein step (b) 
comprises sequentially partitioning said lumi- 
nance coordinate using a splitting criterion that 
depends upon spatial activity characteristics of 
said digital color image. 

33. A method according to 21 , wherein said step 
(b) of performing sequential product code parti- 
tioning of said histogram along its respective 
coordinate axes comprises performing sequen- 
tial binary splitting of said axes along respective 
planes perpendicular to the respective axes be- 
ing split. 

34. A method according to 21, including the 
preliminary step of subsampling said digital col- 
or image for provide a sub-array of digital color 
pixels and steps (a) - (c) are carried out with 
respect to the subsampled digital color image. 

35. A method according to 21, wherein step (a) 
comprises generating said histogram in the form 
of one-dimensional histograms of the color 
space activity of said digital color image, the 
composition off each one-dimensional histogram 
being referenced to a respective one of the 
color coordinates through which the color com- 
position of said digital image is definable. 

36. A method according to 33, wherein step (b) 
comprises performing sequential product code 
partitioning of said one-dimerisional histograms 
along their respectively associated coordinate 
axes, so as to subdivide said one-dimensional 
histograms into a plurality of color cells. 

37. A method according to 21, wherein step (a) 
comprises generating a two-dimensional array of 
color space coordinate data entries, respective 
ones of which are associated with a range of 
color coordinate values of a further color space 
coordinate. 

38. An apparatus for quantizing a data vector 
structure having a multi-dimensional coordinate 
system, comprising a plurality of sequentially 
coupled look-up tables such that an output of an 
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ith look-up table is a pointer to an entry in an 
(i + 1)th look-up table, the respective look-up ta- 
bles of said plurality being associated with the 
respective axes of said multi-dimensional co- 
ordinate system of said data vector structure, 5 
and wherein the output of the last look-up table 
in sequence is a multi-bit code representative of 
a quantized data structure value. 

39. An apparatus according to 38, wherein said 
data vector structure is representative of a digi- 10 
tal color image color space. 

40. An apparatus according to 38, wherein said 
data vector structure is representative of respec- 
tive luminance and chrominance coordinates of 

a digital color image color space. 75 

41. An apparatus according to 38, wherein said 
data vector structure is representative of respec- 
tive luminance and chrominance coordinates of 
a digital color image color space, and wherein 

an ith one of said look-up tables is associated 20 
with a chrominance coordinate of said digital 
color image color space and wherein an (i+j)th 
one of said look-up tables is associated with a 
luminance coordinate of said digital color image 
color space, and wherein the output of the last 25 
look-up table in sequence is a multi-bit code 
representative of a color of said digital image 
color space. 

42. An apparatus according to 38, wherein said 
vector structure is representative of a digital 30 
color image color space, and wherein each look- 
up table is coupled to receive, as part of its 
entry pointer, a code representative of a pre- 
scribed quantization of a coordinate of said digi- 
tal color image color space. 35 

43. An apparatus according to 42, wherein said 
prescribed quantization of a coordinate of said 
digital color image color space corresponds to a 
sequential product code partitioning of said color 
space along that coordinate's axis into a plurality 40 
of color space regions. 

44. An apparatus according to 38, wherein each 
look-up table is coupled to receive, as part off 
its entry pointer, a code representative of a 
prescribed quantization of a coordinate of said 45 
data vector structure, and wherein said pre- 
scribed quantization of a coordinate of said data 
vector structure corresponds to a sequential 
product code partitioning of said data vector 
structure along that coordinate's axes into a 50 
plurality of data vector structure regions. 

45. A method of quantizing a data vector struc- 
ture having a multi-dimensional coordinate sys- 
tem, comprising the steps of: 

(a) providing a plurality of look-up tables, a 55 
respective look-up table of said plurality be- 
ing associated with a respective axis of said 
multi-dimensional coordinate system of said 



data vector structure; and 
(b) sequentially coupling said look-up tables 
together such that an output of an ith look-up 
table is a pointer to an entry in an (i + 1)th 
look-up table, whereby output of the last look- 
up table in sequence is a multi-bit code re- 
presentative of a quantized data structure val- 
ue. 

46. A method apparatus according to 45, 
wherein each look-up table is coupled to re- 
ceive, as part of its entry pointer, a code repre- 
sentative of a prescribed quantization of a co- 
ordinate of said data vector structure, and 
wherein said prescribed quantization of a coordi- 
nate of said data vector structure corresponds to 
a sequential product code partitioning of said 
data vector structure along that coordinate's axis 
into a plurality of data vector structure regions. 

47. A method according to 45, wherein said data 
vector structure is representative of a digital 
color image color space. 

48. A method according to 45, wherein said data 
vector structure is representative of respective 
luminance and chrominance coordinates of a 
digital color image color space. 

49. A method according to 45, wherein said data 
vector structure is representative of respective 
luminance and chrominance coordinates of a 
digital color image color space, and wherein an 
ith one of said look-up tables is associated with 
a chrominance coordinate of said digital color 
image color space and wherein an (i + j)th one of 
said look-up tables is associated with a lumi- 
nance coordinate of said digital color image 
color space, and wherein the output of the last 
look-up table in sequence is a multi-bit code 
representative of a color of said digital image 
color space. 

50. A method according to 45, wherein said 
vector structure is representative of a digital 
color image color space, and wherein each look- 
up table is coupled to receive, as part of its 
entry pointer, a code representative of a pre- 
scribed quantization of a coordinate of said digi- 
tal color image color space. 

51 . For use with a digital color image comprised 
of an array of pixels the color compositions of 
which are digitized to a prescribed color code 
resolution, a method of quantizing a multi-di- 
mensional color space structure through which 
the color compositions of the pixels of said array 
are definable, comprising the steps of: 

(a) providing a multi-dimensional data struc- 
ture representative of the multi-dimensional 
color space of said digital color image; and 

(b) performing sequential product code parti- 
tioning of said multi-dimensional data struc- 
ture along at least one of is respective co- 
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ordinate axes into a plurality of color cells. 

52. A method according to 51 , wherein step (b) 
comprises performing sequential product code 
partitioning of said multi-dimensional data struc- 
ture along each of its respective coordinate axes 5 
into a plurality of multi-dimensional color cells. 

53. A method according to 52, wherein step (a) 
comprises providing a luminance, chrominance 
data structure associated with a luminance, 
chrominance color space representative of said 10 
digital color image, and wherein step (b) com- 
prises performing sequential product code parti- 
tioning of said luminance, chrominance data 
structure along each of its respective chromin- 
ance and luminance coordinate axes into a plu- 75 
rality of luminance-chrominance cells, each of 
which is associated with a quantized value of 

said digital color image. 

54. A method according to 51, further including 

the step (c) of, for each of the cells into which 20 
said data structure has been partitioned in step 
(b), generating a respective color code repre- 
sentative of the color space contents of that cell. 

55. A method according to 54, wherein step (c) 
comprises generating a respective color code 25 
representative of the centroid of the color space 
contents of that cell. 

56. A method according to 54, wherein step (c) 
comprises, for each of the coordinates of said 
data structure, generating a respective look-up 30 
table that associates the digitized color com- 
position for that respective coordinate of said 
digital color image with its quantized coordinate 
value. 

57. A method according to 56, wherein step (c) 36 
comprises sequentially coupling the look-up ta- 
bles together, and generating therefrom, in re- 
sponse to the color composition of a pixel of 

said digitized color image, a respective color 
code which is representative of the color com- 40 
position of said digital color image. 

58. A method according to 51, wherein at least 
one of the coordinate axes of the multi-dimen- 
sional data structure provided in step (a) is 
prequantized to a digital precision less than the 45 
digital precision to which at least one of the 
color coordinates of said digital color image is 
encoded. 

59. A method according to 58, wherein a 
prequantized coordinate axis corresponds to a so 
coordinate axis of said multi-dimensional data 
structure where the sensitivity of the human 
visual system is reduced in comparison to an- 
other coordinate axis of said multi-dimensional 
data structure. 55 

60. A method according to 59, wherein a 
prequantized coordinate axis corresponds to a 
chrominance coordinate axis of a luminance- 



chrominance data structure where the sensitivity 
of the human visual system is reduced in com- 
parison to a luminance coordinate axis of sad 
data structure. 

61. In a method of quantizing the color composi- 
tion of a digital color image comprised of an 
array of pixels which are digitized to a pre- 
scribed color code precision, the improvements 
comprising providing a multi-dimensional data 
structure representative of the multi-dimensional 
color space of said digital color image, and 
wherein at least one of the coordinates of said 
multi-dimensional data stricture is prequantized 
to a digital precision less than the digital preci- 
sion to which at least one of the color coordi- 
nates of said digital color image is encoded. 

62. The improvement according to 61 , wherein a 
prequantized coordinate axis corresponds to a 
coordinate axis off said multi-dimensional data 
structure where the sensitivity of the human 
visual system is reduced in comparison to an- 
other coordinate axis of said multi-dimensional 
data structure. 

63. The improvement according to 61 , wherein a 
prequantized coordinate axis corresponds to a 
chrominance coordinate axis of a luminance- 
chrominance data structure where the sensitivity 
of the human visual system is reduced in com- 
parison to a luminance coordinate axis of said 
data structure. 

64. For use with a digital color image comprised 
of an array of pixels the color compositions of 
which are digitized to a prescribed color code 
resolution, a method of quantizing a multi-di- 
mensional color space structure through which 
the color compositions off the pixels of said 
array are definable, comprising the steps of: 

(a) providing a multi-dimensional data struc- 
ture representative of the multi-dimensional 
color space of said digital color image; and 

(b) partitioning said multi-dimensional data 
structure along one of its respective coordi- 
nate axes into a plurality of color cells using 
an axis-splitting criterion that depends upon 
spatial activity characteristics of said digital 
color image along that axis. 

65. A method according to 64, wherein step (a) 
comprises providing a luminance, chrominance 
data structure associated with a luminance, 
chrominance color space representative off said 
digital color image, and wherein step (b) com- 
prises performing sequential product code parti- 
tioning off said luminance, chrominance data 
structure along each of its respective chromin- 
ance and luminance coordinate axes into a plu- 
rality of luminance-chrominance cells, each of 
which is associated with a quantized value of 
said digital color image, and wherein the parti- 
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tioning of said multi-dimensional data structure 
along its luminance coordinate axes into a plu- 
rality of color cells employs an axis-splitting 
criterion that depends upon spatial activity char- 
acteristics of said digital color image along the 5 
luminance axis. 

66. A method according to 64, wherein the co- 
ordinates of the color space of said digital color 
image correspond to a luminance coordinate 

and a pair of chrominance coordinates, and 10 
wherein step (b) comprises partitioning the cor- 
responding luminance-chrominance data struc- 
ture by sequential product code partitioning of 
said data structure along its respective coordi- 
nate luminance and chrominance axes, in accor- 75 
dance with a splitting criterion that depends 
upon the variance of the contents of said data 
structure for that portion of a respective axis to 
be split, and such that the partitioning of said 
luminance-chrominance data structure along its 20 
luminance coordinate axis into a plurality of col- 
or cells employs an axis-splitting criterion that 
depends upon spatial activity weighting of the 
variance of the contents of said data structure 
along the luminance axis. 25 

67. A method of quantizing a multi-coordinate 
data vector structure comprising the steps of: 

(a) generating a first one-dimensional data 
vector structure by projecting components of 

said multi-coordinate data structure onto a 30 
first coordinate axis thereof; 

(b) iteratively partitioning said first one-di- 
mensional data vector structure into a first 
plurality of one-dimensional data vector struc- 
ture regions; 35 

(c) for each of the first plurality of one-dimen- 
sional data vector structure regions partition- 
ed in step (b), generating a respective asso- 
ciated second one-dimensional data vector 
structure by projecting components of said 40 
multi-coordinate data structure contained 
within said first plurality of one-dimensional 
data vector structure regions onto a second 
coordinate axis of said multi-dimensional data 
vector structure; and 45 

(d) iteratively partitioning the second one- 
dimensional data vector structures generated 
in step (c) into a second plurality of one- 
dimensional data vector structure regions. 

68. A method according to 67, further including so 
the step of (e) generating a plurality of codes 
respectively associated with each of said sec- 
ond plurality of one-dimensional data vector 
structure regions iteratively partitioned in step 

(d). 55 

69. A method according to 67, further including 
the steps of: 



(e) for each of the second plurality of one- 
dimensional data vector structure regions 
partitioned in step (d), generating a respec- 
tive associated third one-dimensional data 
vector structure by projecting components of 
said multi-coordinate data structure contained 
within said second plurality of one-dimen- 
sional data vector structure regions onto a 
third coordinate axis of said multi-dimensional 
data vector structure; and 

(f) iteratively partitioning the third one-dimen- 
sional data vector structures generated in 
step (e) into a third plurality of one-dimen- 
sional data vector structure regions. 

70. A method according to 69, further including 
the step of (g) generating a plurality of codes 
respectively associated with each of the third 
plurality of one-dimensional data vector structure 
regions iteratively partitioned in step (f). 

71. A method according to 67, wherein said 
multi-coordinate data vector structure comprises 
a multi-dimensional color space structure 
through which the color compositions of the 
pixels of a digital color image comprised of an 
array of pixels the color compositions of which 
are digitized to a prescribed color code resolu- 
tion. 

72. A method according to 71, wherein said 
multi-coordinate data vector structure comprises 
a three-dimensional luminance-chrominance 
histogram through which the color compositions 
of the pixels of a digital color image comprised 
of an array of pixels the color compositions of 
which are digitized to a prescribed color code 
resolution. 

73. A method according to 72, wherein step (a) 
comprises generating a first one-dimensional 
luminance-chrominance histogram by projecting 
components of said luminance-chrominance 
histogram onto a first chrominance axis thereof, 
step (b) comprises iteratively partitioning said 
first one-dimensional luminance-chrominance 
histogram into a first plurality of one-dimensional 
luminance-chrominance regions, step (c) com- 
prises generating a respective associated sec- 
ond one-dimensional luminance-chrominance 
histogram by projecting components of said 
luminance-chrominance histogram contained 
within said first plurality of one-dimensional 
luminance-chrominance histogram regions onto 
a second chrominance axis of said threenJimen- 
sional luminance-chrominance histogram, for 
each of the first plurality of one-dimensional 
luminance-chrominance histogram regions par- 
titioned in step (b), and wherein step (d) com- 
prises iteratively partitioning the second one- 
dimensional luminance-chrominance histograms 
generated in step (c) into a second plurality of 



20 



39 



EP 0 555 835 A2 



40 



one-dimensional luminance-chrominance histo- 
gram regions. 

74. A method according to 73, further including 
the steps of: 

(e) for each of the second plurality of one- 5 
dimensional luminance-chrominance histo- 
gram regions partitioned in step (d), generat- 
ing a respective associated third one-dimen- 
sional luminance-chrominance histogram by 
projecting components of said luminance- 10 
chrominance coordinate data structure con- 
tained within said second plurality of one- 
dimensional luminance-chrominance histo- 
gram regions onto the luminance axis of said 
three-dimensional luminance-chrominance 15 
histogram; and 

(f) iteratively partitioning the third one-dimen- 
sional luminance-chrominance histograms 
generated in step (e) into a third plurality of 
one-dimensional luminance-chrominance 20 
histogram regions. 

75. A method according to 74, wherein each of 
steps (b), (d) and (f) comprises partitioning a 
corresponding one-dimensional luminance- 
chrominance histogram by sequential product 25 
code partitioning of said one-dimensional 
luminance-chrominance histogram in accor- 
dance with a splitting criterion that depends 
upon the variance of the contents of said one- 
dimensional histogram for that portion of a re- 30 
spective axis to be split, and such that the 
partitioning of said third one-dimensional 
luminance-chrominance histogram along the lu- 
minance coordinate axis into a plurality of color 
cells employs an axis-splitting criterion that de- 35, 
pends upon spatial activity weighting of the vari- 
ance of the contents of said luminance-chromin- 
ance histogram along the luminance axis. 

76. A method of quantizing a multi-coordinate 
data vector structure comprising the steps of: 40 

(a) generating a two-dimensional array of 
data vector entries, respective ones of which 
are associated with data structures of a third 
coordinate of said multi-coordinate data vec- 
tor structure; and 45 

(b) for a respective data entry of said multi- 
coordinate data structure accessing said two- 
dimensional array of data vector entries and 
locating, along said third coordinate, a cor- 
responding value of said data entry. so 

77. A method according to 76, wherein step (a) 
comprises storing an entry value of said third 
coordinate of said data structure as a binary tree 
structure, and wherein step (b) comprises locat- 
ing said corresponding value of said data entry 55 
by conducting a binary search along said third 
coordinate of said two-dimensional array. 



78. A method according to 76, wherein said 
multi-coordinate data vector structure comprises 
a digital color image color space, and each 
entry of said two-dimensional array is a look-up 
table of color data covering the range of lu- 
minance values for a respective chrominance 
coordinate location of said color space. 

79. A method according to 76, wherein at least 
one of the color coordinates of the two-dimen- 
sional array is prequantized to a digital precision 
less than the digital precision to which color 
coordinates of said digital color image are en- 
coded. 

80. A method according to 79, wherein step (a) 
comprises storing an entry value of said third 
coordinate of said data structure as a binary tree 
structure, and wherein step (b) comprises locat- 
ing said corresponding value of said data entry 
by conducting a binary search along said third 
coordinate of said two-dimensional array. 

Claims 

1. A method of converting a first digital color 
image, having the color composition of each of 
its pixels encoded into first luminance and 
chrominance representative codes of a first 
encoded color resolution, to a second digital 
color image having the color composition of 
each of its pixels encoded at a second en- 
coded color resolution different from that of 
said first digital color image and color codes of 
which are selected to reproduce a color image 
having a quality that is pleasing to the human 
visual system comprising the steps of: 

(a) subdividing said first digital color image 
into a plurality of spatially adjacent groups 
of pixels; 

(b) for each group of pixels subdivided in 
step (a), deriving a luminance activity value 
from the first luminance representative 
codes associated therewith; 

(c) generating a histogram of said first lu- 
minance and chrominance representative 
codes; 

(d) associating the luminance activity values 
derived in step (b) with the histogram gen- 
erated in step (c); 

(e) partitioning said histogram, along an axis 
associated with the chrominance component 
of said first digital color image, into histo- 
gram chrominance regions, based upon the 
chrominance composition of said histogram; 

(f) partitioning said histogram chrominance 
regions, along an axis associated with the 
luminance component of said first digital 
color image, into histogram luminance- 
chrominance regions, based upon the dis- 
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tribution of the luminance activity values 
within said histogram chrominance regions; 

(g) for each of said histogram chrominance 
and luminance regions, deriving a respec- 
tive set of chrominance and luminance out- 
put codes based upon the manner in which 
chrominance composition and luminance 
activity is distributed within said histogram 
chrominance and luminance regions, re- 
spectively; and 

(h) defining the color composition of a re- 
spective pixel of said second digital color 
image in accordance with one of the sets of 
chrominance and luminance output codes 
derived in step (g). 

Z A method according to claim 1, wherein step 
(h) comprises generating a map of chromin- 
ance and luminance output codes for the re- 
spective pixels of said second digital color 
image in accordance with a quantization of the 
chrominance component of said first digital 
color image into chrominance values associ- 
ated with said histogram chrominance regions. 

a A method according to claim 2, wherein step 
(h) comprises generating said map of chromin- 
ance and luminance output codes in accor- 
dance with the luminance representative codes 
through which the color composition of each of 
the pixels of said first digital color image is 
encoded. 

4. A method according to claim 1, further com- 
prising the step of 

(i) transforming said map of chrominance 
and luminance output codes of said second 
digital color image into sets of output color 
codes for application to a color image re- 
production device through which a color 
output image is provided. 

5. A method of quantizing the color composition 
of a digital color image comprising the steps 
of: 

(a) generating a histogram of the color com- 
position of the pixels of said digital color 
image in terms of prescribed color coordi- 
nates through which the color composition 
of said digital image is definable; 

(b) performing sequential product code par- 
titioning of said histogram along its respec- 
tive coordinate axes, so as to subdivide said 
histogram into a plurality of color space 
regions; and 

(c) for each of the color space regions into 
which said histogram has been subdivided 
in step (b), deriving a respective output 



code representative of the color space con- 
tents of that region. 

6. A method according to claim 5, further includ- 
5 ing the step of (d) associating respective ones 

of the output codes derived in step (c) with 
pixels of an output image, which correspond 
spatially to the pixels of said digital color im- 
age. 

10 

7. A method according to claim 6, further includ- 
ing the step of (e) transforming the respective 
codes of said output image into output color 
codes for application to a color image repro- 

75 duction device through which a color output 

image is provided. 

8. A method according to claim 5, wherein at 
least one of the prescribed color coordinates of 

20 the histogram generated in step (a) is prequan- 

tized to a digital resolution less than the digital 
resolution to which said at least one of the 
prescribed color coordinates of said digital col- 
or image is encoded. 

25 

9. A method according to claim 8, wherein the 
prescribed color coordinates of said digital col- 
or image correspond to respective chromin- 
ance and luminance coordinates of the color 

30 space into which said digital color image has 

been encoded. 

10. A method according to claim 9, wherein said at 
least one prescribed color coordinate of the 

35 histogram generated in step (a) includes a 

chrominance coordinate, wherein the pre- 
scribed color coordinates of said digital color 
image correspond to a luminance and a pair of 
chrominance coordinates of the color space 

40 into which said digital color image has been 

encoded, and wherein said at least one pre- 
scribed color coordinate of the histogram gen- 
erated in step (a) includes each of said 
chrominance coordinates, and wherein the pre- 

45 scribed color coordinates of said digital color 

image correspond to a luminance coordinate 
and a pair of chrominance coordinates of the 
color space into which said digital color image 
has been encoded, and wherein each of the 

so chrominance coordinates of the histogram gen- 

erated in step (a) is prequantized to a digital 
resolution less than the digital resolution to 
which said digital color image is encoded, and 
said luminance coordinate of the histogram 

55 generated in step (a) has the same digital 

resolution as said digital color image. 
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11. A method of generating a plurality off color 
codes, respective ones off which represent the 
color composition of a digital color image com- 
posed of an array of pixels, the color composi- 
tions of which are digitized to a prescribed 5 
color code resolution, comprising the steps of: 

(a) generating a histogram of the color com- 
position of the pixels of said digital color 
image in terms of prescribed color coordi- 
nates through which the color composition 10 
of said digital image is definable; 

(b) quantizing the color composition of 
histogram by performing sequential product 
code partitioning of said histogram along its 
respective coordinate axes into a plurality of ts 
color cells; 

(c) for each of the color cells into which said 
histogram has been partitioned in step (b), 
generating a respective color code repre- 
sentative of the color space contents of that 20 
cell. 

12. A method according to claim 11, wherein step 
(c) comprises generating a respective color 
code representative of the centroid of the color 25 
space contents of that cell. 

13. An apparatus for quantizing a data vector 
structure having a multi-dimensional coordinate 
system, comprising a plurality of sequentially 30 
coupled look-up tables such that an output of 

an ith look-up table is a pointer to an entry in 
an (i + 1 )th look-up table, the respective look-up 
tables off said plurality being associated with 
the respective axes of said multi-dimensional 35 
coordinate system of said data vector struc- 
ture, and wherein the output off the last look- 
up table in sequence is a multi-bit code repre- 
sentative of a quantized data structure value. 

40 

14. An apparatus according to claim 13, wherein 
said data vector structure is representative of a 
digital color image color space. 

15. A method of quantizing a data vector structure 45 
having a multi-dimensional coordinate system, 
comprising the steps of: 

(a) providing a plurality of look-up tables, a 
respective look-up table of said plurality be- 
ing associated with a respective axis of said 50 
multi-dimensional coordinate system of said 
data vector structure; and 

(b) sequentially coupling said look-up tables 
together such that an output off an ith look- 
up table is a pointer to an entry in an (i + 1 >- 55 
th look-up table, whereby output off the last 
look-up table in sequence is a multi-bit code 
representative off a quantized data structure 



value. 

16. For use with a digital color image comprised of 
an array of pixels the color compositions of 
which are digitized to a prescribed color code 
resolution, a method of quantizing a multi-di- 
mensional color space structure through which 
the color compositions of the pixels of said 
array are definable, comprising the steps of: 

(a) providing a multi-dimensional data struc- 
ture representative of the multi-dimensional 
color space of sad digital color image; and 

(b) performing sequential product code par- 
titioning of said multi-dimensional data 
structure along at least one of its respective 
coordinate axes into a plurality of color 
cells. 

17. A method according to claim 16, wherein step 
(b) comprises performing sequential product 
code partitioning of said multi-dimensional data 
structure along each of its respective coordi- 
nate axes into a plurality of multi-dimensional 
color cells. 

18. In a method of quantizing the color composi- 
tion of a digital color image comprised of an 
array of pixels which are digitized to a pre- 
scribed color code precision, the improvement 
comprising providing a multi-dimensional data 
structure representative of the multi-dimension- 
al color space of said digital color image, and 
wherein at least one of the coordinates of said 
multi-dimensional data structure is prequan- 
tized to a digital precision less than the digital 
precision to which at least one of the color 
coordinates of said digital color image is en- 
coded. 

19. The improvement according to claim 18, 
wherein a prequantized coordinate axis cor- 
responds to a coordinate axis of said multi- 
dimensional data structure where the sensitiv- 
ity off the human visual system is reduced in 
comparison to another coordinate axis of said 
multi-dimensional data structure. 

20. For use with a digital color image comprised of 
an array off pixels the color compositions of 
which are digitized to a prescribed color code 
resolution, a method of quantizing a multi-di- 
mensional color space structure through which 
the color compositions of the pixels of said 
array are definable, comprising the steps of: 

(a) providing a multi-dimensional data struc- 
ture representative of the multi-dimensional 
color space of said digital color image; and 
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(b) partitioning said multi-dimensional data 
structure along one of its respective coordi- 
nate axes into a plurality of color cells using 
an axis-splitting criterion that depends upon 
spatial activity characteristics of said digital 5 
color image along that axis. 

21. A method according to claim 20, wherein step 

(a) comprises providing a luminance, chromin- 
ance data structure associated with a lumi- 10 
nance, chrominance color space representative 

of said digital color image, and wherein step 

(b) comprises performing sequential product 
code partitioning off said luminance, chromin- 
ance data structure along each of its respec- 75 
tive chrominance and luminance coordinate 
axes into a plurality off luminance-chrominance 
cells, each of which is associated with a quan- 
tized value off said digital color image, and 
wherein the partitioning of said multi-dimen- 20 
sional data structure along its luminance co- 
ordinate axes into a plurality of color cells 
employs an axis-splitting criterion that depends 
upon spatial activity characteristics of said digi- 
tal color image aJong the luminance axis. 25 

22. A method of quantizing a multi-coordinate data 
vector structure comprising the steps of: 

(a) generating a first one-dimensional data 
vector structure by projecting components 30 
of said multi-coordinate data structure onto 

a first coordinate axis thereof; 

(b) iteratively partitioning said first one-di- 
mensional data vector structure into a first 
plurality of one-dimensional data vector 35 
structure regions; 

(c) for each of the first plurality of one- 
dimensional data vector structure regions 
partitioned in step (b), generating a respec- 
tive associated second one-dimensional ao 
data vector structure by projecting compo- 
nents off said multi-coordinate data struc- 
ture contained within said first plurality of 
one-dimensional data vector structure re- 
gions onto a second coordinate axis of said 45 
multi-dimensional data vector structure; and 

(d) iteratively partitioning the second -one- 
dimensional data vector structures gener- 
ated in step (c) into a second plurality of 
one-dimensional data vector structure re- 50 
gions. 

23. A method of quantizing a multi-coordinate data 
vector structure comprising the steps of: 

(a) generating a two-dimensional array of 55 
data vector entries, respective ones of 
which are associated with data structures of 
a third coordinate of said multi-coordinate 



data vector structure; and 
(b) for a respective data entry of said multi- 
coordinate data structure accessing said 
two-dimensional array of data vector entries 
and locating along said third coordinate, a 
corresponding value of said data entry. 

24. A method according to claim 23, wherein step 
(a) comprises storing an entry value of said 
third coordinate of said data structure as a 
binary tree structure, and wherein step (b) 
comprises locating said corresponding value of 
said data entry by conducting a binary search 
along said third coordinate of said two-dimen- 
sional array. 

25. A method of converting a first digital color 
image, to reproduce a color image having a 
quality that is pleasing to the human visual 
system comprising the steps of: 

(a) subdividing said first digital color image 
into a plurality of spatially adjacent groups 
of pixels; 

(b) for each group of pixels subdivided in 
step (a), deriving a luminance activity value 
from the first luminance representative 
codes associated therewith; 

(c) generating a histogram of said first lu- 
minance and chrominance representative 
codes; and 

(d) associating the luminance activity values 
derived in step (b) with the histogram gen- 
erated in step (c). 
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